[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:56 dist-test-slave-bndk krb5kdc[13300](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:56 dist-test-slave-bndk krb5kdc[13300](info): set up 2 sockets
Aug 08 05:07:56 dist-test-slave-bndk krb5kdc[13300](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260808 05:07:57.857810 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.120s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:07:57 dist-test-slave-bndk krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:07:57.971733 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39939
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:39939
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:58.055485 13318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:58.055682 13318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:58.055703 13318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:58.056777 13318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:07:58.056806 13318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:58.056819 13318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:58.056830 13318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:07:58.056840 13318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:07:58.058454 13318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:39939
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39939
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:58.058779 13318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:58.059005 13318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:07:58.065058 13318 server_base.cc:1034] running on GCE node
W20260808 05:07:58.066527 13327 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:58.066584 13324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:58.066701 13325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:58.067026 13318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:58.067457 13318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:58.068603 13318 hybrid_clock.cc:648] HybridClock initialized: now 1786165678068585 us; error 34 us; skew 500 ppm
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:58.071095 13318 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:07:58.071762 13318 webserver.cc:460] Webserver started at http://127.12.251.62:38535/ using document root <none> and password file <none>
I20260808 05:07:58.072036 13318 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:58.072091 13318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:58.072274 13318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:58.073486 13318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "e0c33e6cc82744e08f352d4424be2fd0"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "4d56f526a1d9c6a0b984123fd79009b5"
server_key_iv: "c714d92d6060795158c09e3284b10573"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.073822 13318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "e0c33e6cc82744e08f352d4424be2fd0"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "4d56f526a1d9c6a0b984123fd79009b5"
server_key_iv: "c714d92d6060795158c09e3284b10573"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.075590 13318 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:07:58.076555 13342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.076786 13318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:07:58.076877 13318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "e0c33e6cc82744e08f352d4424be2fd0"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "4d56f526a1d9c6a0b984123fd79009b5"
server_key_iv: "c714d92d6060795158c09e3284b10573"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.076947 13318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:58.106535 13318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:58.108863 13318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:58.109050 13318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:58.113871 13318 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:39939
I20260808 05:07:58.113950 13421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:39939 every 8 connection(s)
I20260808 05:07:58.114516 13318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:07:58.115921 13422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:07:58.116801 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13318
I20260808 05:07:58.116914 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:07:58.117784 13292 external_mini_cluster.cc:1428] Setting key 677cdf0c8bf3ec8a93ae3815fdba239f
I20260808 05:07:58.120347 13422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0: Bootstrap starting.
I20260808 05:07:58.121557 13422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0: Neither blocks nor log segments found. Creating new log.
I20260808 05:07:58.122026 13422 log.cc:824] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:07:58.122915 13422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0: No bootstrap required, opened a new log
I20260808 05:07:58.125802 13422 raft_consensus.cc:348] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0c33e6cc82744e08f352d4424be2fd0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39939 } }
I20260808 05:07:58.125972 13422 raft_consensus.cc:374] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:07:58.126048 13422 raft_consensus.cc:729] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0c33e6cc82744e08f352d4424be2fd0, State: Initialized, Role: FOLLOWER
I20260808 05:07:58.126219 13422 consensus_queue.cc:260] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0c33e6cc82744e08f352d4424be2fd0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39939 } }
I20260808 05:07:58.126368 13422 raft_consensus.cc:388] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:07:58.126418 13422 raft_consensus.cc:482] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:07:58.126471 13422 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:07:58.127148 13422 raft_consensus.cc:504] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0c33e6cc82744e08f352d4424be2fd0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39939 } }
I20260808 05:07:58.127382 13422 leader_election.cc:302] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e0c33e6cc82744e08f352d4424be2fd0; no voters:
I20260808 05:07:58.127617 13422 leader_election.cc:288] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:07:58.127650 13429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:07:58.127889 13429 raft_consensus.cc:686] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [term 1 LEADER]: Becoming Leader. State: Replica: e0c33e6cc82744e08f352d4424be2fd0, State: Running, Role: LEADER
I20260808 05:07:58.128050 13429 consensus_queue.cc:237] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0c33e6cc82744e08f352d4424be2fd0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39939 } }
I20260808 05:07:58.128124 13422 sys_catalog.cc:564] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:07:58.128599 13432 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e0c33e6cc82744e08f352d4424be2fd0. Latest consensus state: current_term: 1 leader_uuid: "e0c33e6cc82744e08f352d4424be2fd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0c33e6cc82744e08f352d4424be2fd0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39939 } } }
I20260808 05:07:58.128746 13432 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:58.130322 13430 sys_catalog.cc:455] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e0c33e6cc82744e08f352d4424be2fd0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e0c33e6cc82744e08f352d4424be2fd0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39939 } } }
I20260808 05:07:58.130472 13441 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:07:58.130584 13430 sys_catalog.cc:458] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:07:58.131860 13441 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165677, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:07:58.134519 13441 catalog_manager.cc:1347] Generated new cluster ID: af25188f8c764e2bbe75933a930c6c71
I20260808 05:07:58.134574 13441 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:07:58.137094 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.119322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59844 (local address 127.12.251.62:39939)
0808 05:07:58.119698 (+ 376us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:58.119709 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:58.119873 (+ 164us) server_negotiation.cc:407] Connection header received
0808 05:07:58.122960 (+ 3087us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:58.122969 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:58.123084 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:58.123200 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:58.125536 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.126585 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.128040 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.128833 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.129012 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.132886 (+ 3874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:58.132891 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:58.132891 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:58.132904 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:58.134729 (+ 1825us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.135220 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.135223 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.135223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.135334 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.135571 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.135572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.135572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.135853 (+ 281us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:58.135986 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:58.136696 (+ 710us) server_negotiation.cc:299] Negotiation successful
0808 05:07:58.136861 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":212,"thread_start_us":127,"threads_started":1}
I20260808 05:07:58.144116 13441 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:07:58.144651 13441 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:07:58.147270 13441 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e0c33e6cc82744e08f352d4424be2fd0: Generated new TSK 0
I20260808 05:07:58.147410 13441 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:07:58.180014 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39939
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:58.276430 13460 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:58.276628 13460 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:58.276660 13460 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:58.277808 13460 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:58.277849 13460 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:58.277884 13460 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:07:58.279289 13460 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39939
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13460
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:58.279631 13460 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:58.279865 13460 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:58.286000 13469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:58.286041 13468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:58.286090 13471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:58.286531 13460 server_base.cc:1034] running on GCE node
I20260808 05:07:58.286731 13460 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:58.286960 13460 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:58.288113 13460 hybrid_clock.cc:648] HybridClock initialized: now 1786165678288099 us; error 32 us; skew 500 ppm
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:58.291579 13460 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:07:58.292111 13460 webserver.cc:460] Webserver started at http://127.12.251.1:35939/ using document root <none> and password file <none>
I20260808 05:07:58.292398 13460 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:58.292471 13460 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:58.292604 13460 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:58.293992 13460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "0c2010ca08c94e2e8a71692dcd5d2803"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "14ae18b66e204282219eb34c8d9083e8"
server_key_iv: "2a8a4813da04831628f59f2427cf16c7"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.294411 13460 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "0c2010ca08c94e2e8a71692dcd5d2803"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "14ae18b66e204282219eb34c8d9083e8"
server_key_iv: "2a8a4813da04831628f59f2427cf16c7"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.296267 13460 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260808 05:07:58.297078 13478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.297266 13460 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:07:58.297351 13460 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "0c2010ca08c94e2e8a71692dcd5d2803"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "14ae18b66e204282219eb34c8d9083e8"
server_key_iv: "2a8a4813da04831628f59f2427cf16c7"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.297464 13460 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:58.315097 13460 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:58.317098 13460 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:58.317260 13460 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:58.317519 13460 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:58.317878 13460 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:58.317988 13460 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.318028 13460 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:58.318053 13460 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.324535 13460 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:40325
I20260808 05:07:58.324617 13636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:40325 every 8 connection(s)
I20260808 05:07:58.324882 13460 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:07:58.325805 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13460
I20260808 05:07:58.325903 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:07:58.326061 13292 external_mini_cluster.cc:1428] Setting key 3e84329c440a68a80bb49966a7baa9c2
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:07:58.335079 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.325782 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:49253 (local address 127.12.251.62:39939)
0808 05:07:58.325849 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:58.325851 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:58.326126 (+ 275us) server_negotiation.cc:407] Connection header received
0808 05:07:58.326721 (+ 595us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:58.326722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:58.326731 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:58.326759 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:58.327830 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.328426 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.329547 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.329829 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.329899 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.332271 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:58.332272 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:58.332273 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:58.332281 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:58.333815 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.334192 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.334193 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.334194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.334254 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.334464 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.334465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.334465 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.334604 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:58.334678 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:58.334896 (+ 218us) server_negotiation.cc:299] Negotiation successful
0808 05:07:58.334985 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:07:58.335141 13639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.325748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39939 (local address 127.12.251.1:49253)
0808 05:07:58.326008 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:58.326045 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:58.326626 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:58.326822 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:58.326825 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:58.327504 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:58.327742 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:58.327749 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.328515 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.328516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:58.329471 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:58.329475 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.329911 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.329912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:58.330033 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.330540 (+ 507us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:58.330552 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:58.332182 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:58.333905 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:58.333911 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:58.333913 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:58.334123 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:58.334317 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:58.334317 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:58.334318 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:58.334407 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:58.334665 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:58.334668 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:58.334772 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 05:07:58.334848 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:07:58.334980 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
I20260808 05:07:58.335666 13637 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39939
I20260808 05:07:58.335757 13637 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:58.335927 13637 heartbeater.cc:511] Master 127.12.251.62:39939 requested a full tablet report, sending...
I20260808 05:07:58.336870 13362 ts_manager.cc:194] Registered new tserver with Master: 0c2010ca08c94e2e8a71692dcd5d2803 (127.12.251.1:40325)
I20260808 05:07:58.337611 13362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:49253
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:07:58.352288 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39939
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:58.434161 13644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:58.434367 13644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:58.434397 13644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:58.435510 13644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:58.435549 13644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:58.435581 13644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:07:58.436991 13644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39939
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:58.437252 13644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:58.437475 13644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:58.442415 13652 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:58.442541 13644 server_base.cc:1034] running on GCE node
W20260808 05:07:58.442399 13656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:58.442380 13653 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:58.442845 13644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:58.443070 13644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:58.444199 13644 hybrid_clock.cc:648] HybridClock initialized: now 1786165678444187 us; error 32 us; skew 500 ppm
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:58.446569 13644 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:07:58.446982 13644 webserver.cc:460] Webserver started at http://127.12.251.2:38897/ using document root <none> and password file <none>
I20260808 05:07:58.447176 13644 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:58.447223 13644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:58.447345 13644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:58.448323 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "6fd7aee63eb344e5b9b2943e640ffcfa"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "7bf69aeb3984847a5d5e9920185691fd"
server_key_iv: "6c399758e8baa4309e709976ea05f51b"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.448653 13644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "6fd7aee63eb344e5b9b2943e640ffcfa"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "7bf69aeb3984847a5d5e9920185691fd"
server_key_iv: "6c399758e8baa4309e709976ea05f51b"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.449962 13644 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:07:58.450606 13664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.450753 13644 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:07:58.450835 13644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "6fd7aee63eb344e5b9b2943e640ffcfa"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "7bf69aeb3984847a5d5e9920185691fd"
server_key_iv: "6c399758e8baa4309e709976ea05f51b"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.450894 13644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:58.469134 13644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:58.470918 13644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:58.471050 13644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:58.471276 13644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:58.471592 13644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:58.471626 13644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.471654 13644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:58.471686 13644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.477924 13644 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:37071
I20260808 05:07:58.477975 13827 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:37071 every 8 connection(s)
I20260808 05:07:58.478267 13644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:07:58.486845 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.478924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:53961 (local address 127.12.251.62:39939)
0808 05:07:58.478983 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:58.478985 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:58.479177 (+ 192us) server_negotiation.cc:407] Connection header received
0808 05:07:58.479707 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:58.479708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:58.479717 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:58.479769 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:58.480721 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.481211 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.482330 (+ 1119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.482506 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.482549 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.484589 (+ 2040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:58.484591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:58.484591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:58.484598 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:58.485718 (+ 1120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.486060 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.486060 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.486061 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.486102 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.486378 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.486378 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.486378 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.486469 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:58.486514 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:58.486725 (+ 211us) server_negotiation.cc:299] Negotiation successful
0808 05:07:58.486780 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:07:58.487012 13831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.478892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39939 (local address 127.12.251.2:53961)
0808 05:07:58.479056 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:58.479098 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:58.479628 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:58.479825 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:58.479828 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:58.480459 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:58.480652 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:58.480657 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.481352 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.481353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:58.482251 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:58.482254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.482568 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.482568 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:58.482670 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.483131 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:58.483139 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:58.484508 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:58.485782 (+ 1274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:58.485789 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:58.485792 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:58.486002 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:58.486175 (+ 173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:58.486176 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:58.486177 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:58.486290 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:58.486513 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:58.486517 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:58.486627 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 05:07:58.486706 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:07:58.486820 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":93,"threads_started":1}
I20260808 05:07:58.487378 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13644
I20260808 05:07:58.487460 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:07:58.487557 13828 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39939
I20260808 05:07:58.487612 13292 external_mini_cluster.cc:1428] Setting key 51dcb0c113aeae507774b30a327cbbd7
I20260808 05:07:58.487651 13828 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:58.487834 13828 heartbeater.cc:511] Master 127.12.251.62:39939 requested a full tablet report, sending...
I20260808 05:07:58.488260 13362 ts_manager.cc:194] Registered new tserver with Master: 6fd7aee63eb344e5b9b2943e640ffcfa (127.12.251.2:37071)
I20260808 05:07:58.488672 13362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:53961
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:07:58.511682 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39939
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36005
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:07:58.597292 13839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:07:58.597492 13839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:07:58.597515 13839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:07:58.598600 13839 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:07:58.598634 13839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:07:58.598659 13839 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:07:58.600063 13839 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36005
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39939
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13839
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:07:58.600308 13839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:07:58.600502 13839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:07:58.605136 13846 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:58.605302 13850 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:07:58.605188 13848 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:07:58.605291 13839 server_base.cc:1034] running on GCE node
I20260808 05:07:58.605613 13839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:07:58.605825 13839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:07:58.606971 13839 hybrid_clock.cc:648] HybridClock initialized: now 1786165678606955 us; error 28 us; skew 500 ppm
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:07:58.612171 13839 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:07:58.612610 13839 webserver.cc:460] Webserver started at http://127.12.251.3:36687/ using document root <none> and password file <none>
I20260808 05:07:58.612804 13839 fs_manager.cc:359] Metadata directory not provided
I20260808 05:07:58.612851 13839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:07:58.612986 13839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:07:58.614053 13839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "3bbfd07d2ad345b3a0334160b1ad0956"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "0b2501bca7bae8accd98266dbde33060"
server_key_iv: "bb775fedd8ed5232b941b7684c3f4f40"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.614395 13839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "3bbfd07d2ad345b3a0334160b1ad0956"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "0b2501bca7bae8accd98266dbde33060"
server_key_iv: "bb775fedd8ed5232b941b7684c3f4f40"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.615732 13839 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:07:58.616478 13861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.616626 13839 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:07:58.616714 13839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "3bbfd07d2ad345b3a0334160b1ad0956"
format_stamp: "Formatted at 2026-08-08 05:07:58 on dist-test-slave-bndk"
server_key: "0b2501bca7bae8accd98266dbde33060"
server_key_iv: "bb775fedd8ed5232b941b7684c3f4f40"
server_key_version: "encryptionkey@0"
I20260808 05:07:58.616781 13839 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:07:58.632527 13839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:07:58.634276 13839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:07:58.634413 13839 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:07:58.634611 13839 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:07:58.634910 13839 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:07:58.634945 13839 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.634974 13839 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:07:58.634991 13839 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:07:58.641486 13839 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:36111
I20260808 05:07:58.641542 14024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:36111 every 8 connection(s)
I20260808 05:07:58.641839 13839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:07:58.646226 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13839
I20260808 05:07:58.646319 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:07:58.646478 13292 external_mini_cluster.cc:1428] Setting key 210f2b968d90c286e7b20c4797c91a4a
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:07:58.650785 13426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.642552 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:50903 (local address 127.12.251.62:39939)
0808 05:07:58.642616 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:58.642618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:58.642780 (+ 162us) server_negotiation.cc:407] Connection header received
0808 05:07:58.643252 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:58.643253 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:58.643263 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:58.643324 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:58.644254 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.644770 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.645767 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.645979 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.646037 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.648421 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:58.648423 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:58.648423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:58.648430 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:58.649754 (+ 1324us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.650090 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.650090 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.650091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.650136 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.650310 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.650310 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.650311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.650419 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:58.650469 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:58.650664 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 05:07:58.650721 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:07:58.650936 14028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.642509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39939 (local address 127.12.251.3:50903)
0808 05:07:58.642672 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:07:58.642711 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:07:58.643179 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:07:58.643384 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:07:58.643388 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:07:58.643932 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:07:58.644129 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:58.644134 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.644841 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.644842 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:58.645675 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:07:58.645678 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.646050 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.646051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:07:58.646200 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.646724 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:07:58.646735 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:07:58.648338 (+ 1603us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:07:58.649824 (+ 1486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:58.649829 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:58.649831 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:58.650038 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:58.650178 (+ 140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:07:58.650179 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:07:58.650179 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:07:58.650264 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:07:58.650465 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:07:58.650468 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:07:58.650572 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 05:07:58.650646 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:07:58.650758 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":84,"threads_started":1}
I20260808 05:07:58.651350 14025 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39939
I20260808 05:07:58.651430 14025 heartbeater.cc:464] Registering TS with master...
I20260808 05:07:58.651599 14025 heartbeater.cc:511] Master 127.12.251.62:39939 requested a full tablet report, sending...
I20260808 05:07:58.651939 13362 ts_manager.cc:194] Registered new tserver with Master: 3bbfd07d2ad345b3a0334160b1ad0956 (127.12.251.3:36111)
I20260808 05:07:58.652290 13362 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:50903
I20260808 05:07:58.658514 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:07:58.681313 14033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.674391 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.12.251.1:40325)
0808 05:07:58.674631 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:58.674637 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:58.674647 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:07:58.674673 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:58.674675 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:58.674690 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:58.674751 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:58.675251 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.675954 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.676615 (+ 661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.676919 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.676974 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.678978 (+ 2004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:58.678988 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:58.678989 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:58.678996 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:58.680336 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.680671 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.680674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.680674 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.680730 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.680856 (+ 126us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.680857 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.680857 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.680985 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:58.681078 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:58.681135 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 05:07:58.681197 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":157,"threads_started":1}
W20260808 05:07:58.681763 13521 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49050
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[13300](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165678, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:07:58.703261 14033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:07:58.697016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49064 (local address 127.12.251.1:40325)
0808 05:07:58.697080 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:07:58.697081 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:07:58.697135 (+ 54us) server_negotiation.cc:407] Connection header received
0808 05:07:58.697177 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:07:58.697178 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:07:58.697189 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:07:58.697271 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:07:58.697815 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.698315 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.698984 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:07:58.699184 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:07:58.699234 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:07:58.701288 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:07:58.701289 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:07:58.701289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:07:58.701295 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:07:58.702517 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.702764 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.702764 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.702765 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.702810 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:07:58.702923 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:07:58.702924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:07:58.702924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:07:58.703001 (+ 77us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:07:58.703075 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:07:58.703130 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 05:07:58.703186 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:07:58.703733 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13460
I20260808 05:07:58.715862 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13644
I20260808 05:07:58.728967 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13839
I20260808 05:07:58.735034 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13318
2026-08-08T05:07:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2030 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[14043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[14043](info): set up 2 sockets
Aug 08 05:07:58 dist-test-slave-bndk krb5kdc[14043](info): commencing operation
krb5kdc: starting...
W20260808 05:07:59.897506 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.135s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:07:59 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:07:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:07:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:00.012042 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:38669
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:38669
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:00.092728 14060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:00.092928 14060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:00.092957 14060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:00.094045 14060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:00.094077 14060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:00.094089 14060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:00.094101 14060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:00.094112 14060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:00.095546 14060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:38669
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:38669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:00.095745 14060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:00.095918 14060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:00.100617 14075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.100657 14060 server_base.cc:1034] running on GCE node
W20260808 05:08:00.100603 14073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:00.100585 14070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.101034 14060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:00.101354 14060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:00.102506 14060 hybrid_clock.cc:648] HybridClock initialized: now 1786165680102490 us; error 28 us; skew 500 ppm
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:00.104900 14060 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:00.105366 14060 webserver.cc:460] Webserver started at http://127.12.251.62:35923/ using document root <none> and password file <none>
I20260808 05:08:00.105588 14060 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:00.105636 14060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:00.105762 14060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:00.106766 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "5044c1580ed04c0183113e2e00d1b9a3"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "17ff0dceebc9424fba50efbf7897cc67"
server_key_iv: "83ace6e3812832a3da3ac37f3bcb0e68"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.107115 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "5044c1580ed04c0183113e2e00d1b9a3"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "17ff0dceebc9424fba50efbf7897cc67"
server_key_iv: "83ace6e3812832a3da3ac37f3bcb0e68"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.108327 14060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:08:00.108965 14083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.109113 14060 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:00.109207 14060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "5044c1580ed04c0183113e2e00d1b9a3"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "17ff0dceebc9424fba50efbf7897cc67"
server_key_iv: "83ace6e3812832a3da3ac37f3bcb0e68"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.109300 14060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:00.124769 14060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:00.126724 14060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:00.126869 14060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:00.130607 14060 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:38669
I20260808 05:08:00.130651 14155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:38669 every 8 connection(s)
I20260808 05:08:00.130980 14060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:00.131804 14156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:00.134109 14156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3: Bootstrap starting.
I20260808 05:08:00.134681 14156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:00.134938 14156 log.cc:824] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:00.135593 14156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3: No bootstrap required, opened a new log
I20260808 05:08:00.136650 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14060
I20260808 05:08:00.136741 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:00.136895 13292 external_mini_cluster.cc:1428] Setting key 3dd527e4c1e36865907ac59552bde64d
I20260808 05:08:00.137456 14156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5044c1580ed04c0183113e2e00d1b9a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 38669 } }
I20260808 05:08:00.137624 14156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:00.137651 14156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5044c1580ed04c0183113e2e00d1b9a3, State: Initialized, Role: FOLLOWER
I20260808 05:08:00.137750 14156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5044c1580ed04c0183113e2e00d1b9a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 38669 } }
I20260808 05:08:00.137820 14156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:00.137848 14156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:00.137892 14156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:00.138859 14156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5044c1580ed04c0183113e2e00d1b9a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 38669 } }
I20260808 05:08:00.138947 14156 leader_election.cc:302] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5044c1580ed04c0183113e2e00d1b9a3; no voters:
I20260808 05:08:00.139096 14156 leader_election.cc:288] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:00.139129 14165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:00.139235 14165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [term 1 LEADER]: Becoming Leader. State: Replica: 5044c1580ed04c0183113e2e00d1b9a3, State: Running, Role: LEADER
I20260808 05:08:00.139315 14165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5044c1580ed04c0183113e2e00d1b9a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 38669 } }
I20260808 05:08:00.139346 14156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:00.139734 14169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5044c1580ed04c0183113e2e00d1b9a3. Latest consensus state: current_term: 1 leader_uuid: "5044c1580ed04c0183113e2e00d1b9a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5044c1580ed04c0183113e2e00d1b9a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 38669 } } }
I20260808 05:08:00.139827 14169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:00.140158 14172 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:00.140664 14172 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:00.140993 14167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5044c1580ed04c0183113e2e00d1b9a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5044c1580ed04c0183113e2e00d1b9a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 38669 } } }
I20260808 05:08:00.141067 14167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:00.142930 14172 catalog_manager.cc:1347] Generated new cluster ID: a65c8e4d970f4614bbf482f822a5c225
I20260808 05:08:00.142992 14172 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:00.147759 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.137410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48172 (local address 127.12.251.62:38669)
0808 05:08:00.137613 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.137622 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.137656 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:08:00.137779 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.137785 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.137866 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.138007 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.138611 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.139934 (+ 1323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.140938 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.141555 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.141637 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.144335 (+ 2698us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.144339 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.144340 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.144351 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.145878 (+ 1527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.146188 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.146191 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.146192 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.146286 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.146461 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.146462 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.146462 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.146693 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.147454 (+ 761us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.147514 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.147618 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":106,"threads_started":1}
I20260808 05:08:00.150043 14172 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:00.150530 14172 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:00.162037 14172 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5044c1580ed04c0183113e2e00d1b9a3: Generated new TSK 0
I20260808 05:08:00.162202 14172 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:00.190004 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:38669
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:00.270624 14190 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:00.270828 14190 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:00.270864 14190 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:00.272023 14190 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:00.272066 14190 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:00.272102 14190 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:00.273553 14190 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:38669
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14190
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:00.273792 14190 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:00.273989 14190 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:00.278885 14202 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:00.278913 14197 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.279057 14190 server_base.cc:1034] running on GCE node
W20260808 05:08:00.278911 14196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.279333 14190 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:00.279541 14190 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:00.280699 14190 hybrid_clock.cc:648] HybridClock initialized: now 1786165680280679 us; error 36 us; skew 500 ppm
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:00.283115 14190 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:00.283509 14190 webserver.cc:460] Webserver started at http://127.12.251.1:34081/ using document root <none> and password file <none>
I20260808 05:08:00.283694 14190 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:00.283736 14190 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:00.283851 14190 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:00.284854 14190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "4a71c390216b4a06b2e16654d3f35a55"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "86234b5b375f13139f207195e22b803b"
server_key_iv: "610b8da6883f81c4e63cfa647056a836"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.285176 14190 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "4a71c390216b4a06b2e16654d3f35a55"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "86234b5b375f13139f207195e22b803b"
server_key_iv: "610b8da6883f81c4e63cfa647056a836"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.286386 14190 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:00.287010 14211 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.287153 14190 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:00.287230 14190 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "4a71c390216b4a06b2e16654d3f35a55"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "86234b5b375f13139f207195e22b803b"
server_key_iv: "610b8da6883f81c4e63cfa647056a836"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.287293 14190 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:00.300447 14190 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:00.302156 14190 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:00.302275 14190 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:00.302481 14190 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:00.302767 14190 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:00.302800 14190 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.302821 14190 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:00.302845 14190 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.308467 14190 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33993
I20260808 05:08:00.308525 14377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33993 every 8 connection(s)
I20260808 05:08:00.308799 14190 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:00.315205 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14190
I20260808 05:08:00.315296 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:00.315450 13292 external_mini_cluster.cc:1428] Setting key ac0961711d753939b50a5bbfc801aa11
I20260808 05:08:00.318027 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.309488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:58487 (local address 127.12.251.62:38669)
0808 05:08:00.309532 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.309534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.309739 (+ 205us) server_negotiation.cc:407] Connection header received
0808 05:08:00.310737 (+ 998us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.310738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.310752 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.310789 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.311363 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.311901 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.312890 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.313092 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.313147 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.315181 (+ 2034us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.315183 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.315183 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.315190 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.316537 (+ 1347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.316963 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.316964 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.316965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.317019 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.317281 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.317282 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.317282 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.317435 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.317495 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.317838 (+ 343us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.317926 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:00.318173 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.309463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:38669 (local address 127.12.251.1:58487)
0808 05:08:00.309623 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.309663 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.310635 (+ 972us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.310853 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.310856 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.311097 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:00.311278 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.311282 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.311970 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.311970 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.312812 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.312815 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.313179 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.313180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.313372 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.313771 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:00.313779 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:00.315090 (+ 1311us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:00.316612 (+ 1522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:00.316620 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:00.316622 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:00.316890 (+ 268us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:00.317074 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:00.317075 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:00.317075 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:00.317203 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:00.317496 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:00.317502 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:00.317661 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.317804 (+ 143us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.317958 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":68,"threads_started":1}
I20260808 05:08:00.318740 14381 heartbeater.cc:347] Connected to a master server at 127.12.251.62:38669
I20260808 05:08:00.318874 14381 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:00.319082 14381 heartbeater.cc:511] Master 127.12.251.62:38669 requested a full tablet report, sending...
I20260808 05:08:00.319571 14105 ts_manager.cc:194] Registered new tserver with Master: 4a71c390216b4a06b2e16654d3f35a55 (127.12.251.1:33993)
I20260808 05:08:00.320178 14105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:58487
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:00.340371 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:38669
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:00.421267 14390 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:00.421461 14390 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:00.421490 14390 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:00.422595 14390 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:00.422636 14390 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:00.422665 14390 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:00.424118 14390 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:38669
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14390
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:00.424340 14390 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:00.424548 14390 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:00.429298 14396 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:00.429304 14395 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.429363 14390 server_base.cc:1034] running on GCE node
W20260808 05:08:00.429313 14399 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.429641 14390 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:00.429863 14390 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:00.431000 14390 hybrid_clock.cc:648] HybridClock initialized: now 1786165680430990 us; error 25 us; skew 500 ppm
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:00.433385 14390 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:00.433809 14390 webserver.cc:460] Webserver started at http://127.12.251.2:39779/ using document root <none> and password file <none>
I20260808 05:08:00.434031 14390 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:00.434079 14390 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:00.434206 14390 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:00.435192 14390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "9331cf6d7e8849b39541df67b6670adc"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "0237216e6210fcdc20134fdc77ffc9af"
server_key_iv: "75b7322ea59d26b6f2bb0a8c653d6245"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.435523 14390 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "9331cf6d7e8849b39541df67b6670adc"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "0237216e6210fcdc20134fdc77ffc9af"
server_key_iv: "75b7322ea59d26b6f2bb0a8c653d6245"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.436695 14390 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:00.437367 14413 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.437510 14390 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:00.437592 14390 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "9331cf6d7e8849b39541df67b6670adc"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "0237216e6210fcdc20134fdc77ffc9af"
server_key_iv: "75b7322ea59d26b6f2bb0a8c653d6245"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.437657 14390 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:00.454663 14390 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:00.456668 14390 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:00.456799 14390 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:00.456998 14390 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:00.457309 14390 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:00.457346 14390 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.457374 14390 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:00.457399 14390 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.462733 14390 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:35565
I20260808 05:08:00.462786 14572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:35565 every 8 connection(s)
I20260808 05:08:00.463088 14390 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:00.464815 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14390
I20260808 05:08:00.464897 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:00.465065 13292 external_mini_cluster.cc:1428] Setting key 281d0b44483ad6f60a3965f65dd5e385
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:00.472606 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.463724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:53699 (local address 127.12.251.62:38669)
0808 05:08:00.463794 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.463796 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.463968 (+ 172us) server_negotiation.cc:407] Connection header received
0808 05:08:00.464899 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.464900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.464914 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.464977 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.465772 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.466267 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.467590 (+ 1323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.467868 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.467933 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.469966 (+ 2033us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.469967 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.469968 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.469976 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.471388 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.471745 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.471746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.471747 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.471811 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.472022 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.472022 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.472023 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.472151 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.472219 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.472425 (+ 206us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.472509 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:08:00.472661 14575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.463700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:38669 (local address 127.12.251.2:53699)
0808 05:08:00.463848 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.463888 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.464786 (+ 898us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.465101 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.465106 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.465460 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:00.465688 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.465695 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.466361 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.466362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.467509 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.467512 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.467942 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.467943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.468056 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.468486 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:00.468494 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:00.469867 (+ 1373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:00.471462 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:00.471467 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:00.471469 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:00.471679 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:00.471871 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:00.471871 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:00.471871 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:00.471960 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:00.472207 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:00.472209 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:00.472315 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.472386 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.472505 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":80,"threads_started":1}
I20260808 05:08:00.473124 14573 heartbeater.cc:347] Connected to a master server at 127.12.251.62:38669
I20260808 05:08:00.473232 14573 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:00.473400 14573 heartbeater.cc:511] Master 127.12.251.62:38669 requested a full tablet report, sending...
I20260808 05:08:00.473805 14105 ts_manager.cc:194] Registered new tserver with Master: 9331cf6d7e8849b39541df67b6670adc (127.12.251.2:35565)
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
I20260808 05:08:00.474290 14105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:53699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:00.490219 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:38669
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:00.569986 14580 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:00.570181 14580 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:00.570214 14580 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:00.571323 14580 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:00.571362 14580 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:00.571396 14580 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:00.573068 14580 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:38669
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14580
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:00.573341 14580 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:00.573552 14580 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:00.578361 14588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:00.578393 14586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.578480 14580 server_base.cc:1034] running on GCE node
W20260808 05:08:00.578361 14585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:00.578789 14580 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:00.579031 14580 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:00.580179 14580 hybrid_clock.cc:648] HybridClock initialized: now 1786165680580162 us; error 28 us; skew 500 ppm
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:00.582567 14580 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:00.582971 14580 webserver.cc:460] Webserver started at http://127.12.251.3:38707/ using document root <none> and password file <none>
I20260808 05:08:00.583173 14580 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:00.583220 14580 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:00.583346 14580 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:00.584333 14580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "3a65877bfaa54e0785ae4926bc5dc775"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "df319ddadb977c85af4dcd62a59e9cbb"
server_key_iv: "5aedd2defc54028fd32c34cfcd31b3ac"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.584658 14580 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "3a65877bfaa54e0785ae4926bc5dc775"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "df319ddadb977c85af4dcd62a59e9cbb"
server_key_iv: "5aedd2defc54028fd32c34cfcd31b3ac"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.585927 14580 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:08:00.586642 14600 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.586799 14580 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:00.586892 14580 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "3a65877bfaa54e0785ae4926bc5dc775"
format_stamp: "Formatted at 2026-08-08 05:08:00 on dist-test-slave-bndk"
server_key: "df319ddadb977c85af4dcd62a59e9cbb"
server_key_iv: "5aedd2defc54028fd32c34cfcd31b3ac"
server_key_version: "encryptionkey@0"
I20260808 05:08:00.586962 14580 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:00.619508 14580 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:00.621327 14580 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:00.621460 14580 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:00.621665 14580 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:00.621966 14580 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:00.622008 14580 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.622035 14580 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:00.622059 14580 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:00.627473 14580 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:46489
I20260808 05:08:00.627530 14787 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:46489 every 8 connection(s)
I20260808 05:08:00.627810 14580 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:00.634879 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14580
I20260808 05:08:00.634964 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:00.635113 13292 external_mini_cluster.cc:1428] Setting key f51bb7f0f1bd56af8567e7488fb4b691
I20260808 05:08:00.636489 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.628533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:40239 (local address 127.12.251.62:38669)
0808 05:08:00.628577 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.628579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.628760 (+ 181us) server_negotiation.cc:407] Connection header received
0808 05:08:00.629751 (+ 991us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.629752 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.629762 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.629810 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.630356 (+ 546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.630849 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.631803 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.631994 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.632041 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.634059 (+ 2018us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.634061 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.634061 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.634067 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.635183 (+ 1116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.635651 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.635652 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.635653 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.635709 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.635951 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.635951 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.635952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.636089 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.636141 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.636363 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.636424 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:00.636649 14793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.628506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:38669 (local address 127.12.251.3:40239)
0808 05:08:00.628648 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.628683 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.629665 (+ 982us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.629872 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.629875 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.630116 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:00.630296 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.630300 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.630907 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.630908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.631741 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.631743 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.632049 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.632050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.632146 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.632600 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:00.632609 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:00.633960 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:00.635262 (+ 1302us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:00.635269 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:00.635271 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:00.635583 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:00.635759 (+ 176us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:00.635760 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:00.635760 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:00.635876 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:00.636142 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:00.636146 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:00.636259 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.636339 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.636463 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":77,"threads_started":1}
I20260808 05:08:00.637053 14788 heartbeater.cc:347] Connected to a master server at 127.12.251.62:38669
I20260808 05:08:00.637145 14788 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:00.637336 14788 heartbeater.cc:511] Master 127.12.251.62:38669 requested a full tablet report, sending...
I20260808 05:08:00.637679 14105 ts_manager.cc:194] Registered new tserver with Master: 3a65877bfaa54e0785ae4926bc5dc775 (127.12.251.3:46489)
I20260808 05:08:00.638024 14105 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:40239
I20260808 05:08:00.646723 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:08:00.654277 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.648539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48180 (local address 127.12.251.62:38669)
0808 05:08:00.648579 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.648581 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.648696 (+ 115us) server_negotiation.cc:407] Connection header received
0808 05:08:00.648753 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.648754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.648764 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.648812 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.649376 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.649834 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.650515 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.650691 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.650743 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.651809 (+ 1066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.651810 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.651810 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.651818 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.653025 (+ 1207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.653401 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.653403 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.653403 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.653498 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.653723 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.653724 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.653725 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.653920 (+ 195us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.654018 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.654154 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.654217 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:08:00.656895 14105 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48180:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:00.658726 14105 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:00.665650 14803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.661567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:35565 (local address 127.0.0.1:34542)
0808 05:08:00.662040 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.662048 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.662090 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.662297 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.662298 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.662300 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:00.662341 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.662342 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.663585 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.663586 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.664675 (+ 1089us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.664677 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.665353 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.665354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.665450 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.665463 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.665523 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.665579 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":48,"threads_started":1}
I20260808 05:08:00.665666 14807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.661790 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34542 (local address 127.12.251.2:35565)
0808 05:08:00.662018 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.662022 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.662144 (+ 122us) server_negotiation.cc:407] Connection header received
0808 05:08:00.662200 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.662202 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.662218 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.662292 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:00.662496 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.663522 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.664757 (+ 1235us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.665269 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.665330 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.665390 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.665543 (+ 153us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.665583 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":113,"threads_started":1}
I20260808 05:08:00.666121 14801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.661533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33993 (local address 127.0.0.1:49022)
0808 05:08:00.661647 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.661686 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.661751 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.662075 (+ 324us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.662078 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.662081 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:00.662147 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.662149 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.663472 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.663473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.664665 (+ 1192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.664668 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.665617 (+ 949us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.665619 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.665687 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.665691 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.666004 (+ 313us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.666049 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"mutex_wait_us":4,"thread_start_us":72,"threads_started":1}
I20260808 05:08:00.666507 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.661734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49022 (local address 127.12.251.1:33993)
0808 05:08:00.661897 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.661902 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.661913 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:08:00.661956 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.661958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.661974 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.662051 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:00.662226 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.663355 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.664766 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.665524 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.666295 (+ 771us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.666361 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.666386 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.666426 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":93,"threads_started":1}
I20260808 05:08:00.666411 14479 tablet_service.cc:1467] Processing CreateTablet for tablet 37313212585b4d4d8a18402d54ff3a24 (DEFAULT_TABLE table=test-table [id=7d306f6c06a64fdf8a83cd55495b22e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:00.666783 14479 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37313212585b4d4d8a18402d54ff3a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:00.667057 14806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.661783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44058 (local address 127.12.251.3:46489)
0808 05:08:00.662093 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.662097 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.662105 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:00.662138 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.662140 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.662154 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.662226 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:00.662414 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.663232 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.665753 (+ 2521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.666431 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.666506 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.666559 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.666941 (+ 382us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.666982 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":280,"thread_start_us":100,"threads_started":1}
I20260808 05:08:00.667040 14277 tablet_service.cc:1467] Processing CreateTablet for tablet 37313212585b4d4d8a18402d54ff3a24 (DEFAULT_TABLE table=test-table [id=7d306f6c06a64fdf8a83cd55495b22e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:00.667297 14802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.661562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:46489 (local address 127.0.0.1:44058)
0808 05:08:00.661927 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.661936 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.661979 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.662304 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.662305 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.662307 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:00.662345 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.662346 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.663316 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.663317 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.665673 (+ 2356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.665675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.666523 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.666524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.666723 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.666728 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.666785 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.666825 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":352,"mutex_wait_us":1199,"thread_start_us":49,"threads_started":1}
I20260808 05:08:00.667326 14277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37313212585b4d4d8a18402d54ff3a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:00.669679 14808 tablet_bootstrap.cc:492] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc: Bootstrap starting.
I20260808 05:08:00.669859 14809 tablet_bootstrap.cc:492] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55: Bootstrap starting.
I20260808 05:08:00.670015 14678 tablet_service.cc:1467] Processing CreateTablet for tablet 37313212585b4d4d8a18402d54ff3a24 (DEFAULT_TABLE table=test-table [id=7d306f6c06a64fdf8a83cd55495b22e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:00.670325 14678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37313212585b4d4d8a18402d54ff3a24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:00.670384 14808 tablet_bootstrap.cc:654] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:00.670454 14809 tablet_bootstrap.cc:654] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:00.671135 14808 log.cc:824] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:00.671816 14808 tablet_bootstrap.cc:492] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc: No bootstrap required, opened a new log
I20260808 05:08:00.671869 14808 ts_tablet_manager.cc:1397] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:08:00.672752 14809 log.cc:824] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:00.672781 14811 tablet_bootstrap.cc:492] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775: Bootstrap starting.
I20260808 05:08:00.673499 14811 tablet_bootstrap.cc:654] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:00.673614 14809 tablet_bootstrap.cc:492] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55: No bootstrap required, opened a new log
I20260808 05:08:00.673689 14809 ts_tablet_manager.cc:1397] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s
I20260808 05:08:00.673614 14808 raft_consensus.cc:348] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.673805 14808 raft_consensus.cc:374] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:00.673853 14808 raft_consensus.cc:729] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9331cf6d7e8849b39541df67b6670adc, State: Initialized, Role: FOLLOWER
I20260808 05:08:00.674053 14811 log.cc:824] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:00.674058 14808 consensus_queue.cc:260] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.674356 14808 ts_tablet_manager.cc:1428] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:08:00.674515 14573 heartbeater.cc:503] Master 127.12.251.62:38669 was elected leader, sending a full tablet report...
I20260808 05:08:00.674734 14811 tablet_bootstrap.cc:492] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775: No bootstrap required, opened a new log
I20260808 05:08:00.674791 14811 ts_tablet_manager.cc:1397] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:00.676342 14811 raft_consensus.cc:348] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.676476 14811 raft_consensus.cc:374] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:00.676507 14811 raft_consensus.cc:729] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a65877bfaa54e0785ae4926bc5dc775, State: Initialized, Role: FOLLOWER
I20260808 05:08:00.676389 14809 raft_consensus.cc:348] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.676585 14809 raft_consensus.cc:374] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:00.676636 14809 raft_consensus.cc:729] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a71c390216b4a06b2e16654d3f35a55, State: Initialized, Role: FOLLOWER
I20260808 05:08:00.676616 14811 consensus_queue.cc:260] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.676749 14809 consensus_queue.cc:260] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.676880 14811 ts_tablet_manager.cc:1428] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:08:00.676900 14788 heartbeater.cc:503] Master 127.12.251.62:38669 was elected leader, sending a full tablet report...
I20260808 05:08:00.677261 14809 ts_tablet_manager.cc:1428] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 05:08:00.677289 14381 heartbeater.cc:503] Master 127.12.251.62:38669 was elected leader, sending a full tablet report...
I20260808 05:08:00.695230 14818 raft_consensus.cc:482] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:00.695329 14818 raft_consensus.cc:504] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.695845 14818 leader_election.cc:288] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3a65877bfaa54e0785ae4926bc5dc775 (127.12.251.3:46489), 9331cf6d7e8849b39541df67b6670adc (127.12.251.2:35565)
I20260808 05:08:00.699474 14807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.696095 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:49223 (local address 127.12.251.2:35565)
0808 05:08:00.696134 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.696136 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.696145 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:00.696169 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.696169 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.696178 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.696228 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:00.696398 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.697131 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.698564 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.699127 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.699202 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.699210 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.699366 (+ 156us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.699398 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:00.699486 14806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.696079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:49491 (local address 127.12.251.3:46489)
0808 05:08:00.696125 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.696128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.696304 (+ 176us) server_negotiation.cc:407] Connection header received
0808 05:08:00.696355 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.696356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.696365 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.696416 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:00.696532 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.697239 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.698557 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.699127 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.699201 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.699210 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.699400 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.699432 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:08:00.699491 14387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.696002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:35565 (local address 127.12.251.1:49223)
0808 05:08:00.696059 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.696071 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.696113 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.696256 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.696257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.696259 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:00.696335 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.696337 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.697209 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.697210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.698474 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.698477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.699205 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.699206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.699304 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.699306 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.699357 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.699400 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":6}
I20260808 05:08:00.699504 14819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.696002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:46489 (local address 127.12.251.1:49491)
0808 05:08:00.696239 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:00.696248 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:00.696302 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:00.696425 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:00.696426 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:00.696428 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:00.696482 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.696483 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.697287 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.697288 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.698474 (+ 1186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:00.698477 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.699205 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.699206 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:00.699302 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.699306 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:00.699393 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:08:00.699423 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":137,"threads_started":1}
I20260808 05:08:00.699930 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37313212585b4d4d8a18402d54ff3a24" candidate_uuid: "4a71c390216b4a06b2e16654d3f35a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9331cf6d7e8849b39541df67b6670adc" is_pre_election: true
I20260808 05:08:00.699945 14715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37313212585b4d4d8a18402d54ff3a24" candidate_uuid: "4a71c390216b4a06b2e16654d3f35a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a65877bfaa54e0785ae4926bc5dc775" is_pre_election: true
I20260808 05:08:00.700096 14510 raft_consensus.cc:2454] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a71c390216b4a06b2e16654d3f35a55 in term 0.
I20260808 05:08:00.700105 14715 raft_consensus.cc:2454] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a71c390216b4a06b2e16654d3f35a55 in term 0.
I20260808 05:08:00.700376 14212 leader_election.cc:302] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a71c390216b4a06b2e16654d3f35a55, 9331cf6d7e8849b39541df67b6670adc; no voters:
I20260808 05:08:00.700503 14818 raft_consensus.cc:2781] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:00.700578 14818 raft_consensus.cc:482] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:00.700603 14818 raft_consensus.cc:3037] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:00.701474 14818 raft_consensus.cc:504] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.701598 14818 leader_election.cc:288] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [CANDIDATE]: Term 1 election: Requested vote from peers 3a65877bfaa54e0785ae4926bc5dc775 (127.12.251.3:46489), 9331cf6d7e8849b39541df67b6670adc (127.12.251.2:35565)
I20260808 05:08:00.701733 14715 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37313212585b4d4d8a18402d54ff3a24" candidate_uuid: "4a71c390216b4a06b2e16654d3f35a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a65877bfaa54e0785ae4926bc5dc775"
I20260808 05:08:00.701736 14510 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37313212585b4d4d8a18402d54ff3a24" candidate_uuid: "4a71c390216b4a06b2e16654d3f35a55" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9331cf6d7e8849b39541df67b6670adc"
I20260808 05:08:00.701810 14715 raft_consensus.cc:3037] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:00.701812 14510 raft_consensus.cc:3037] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:00.702487 14510 raft_consensus.cc:2454] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a71c390216b4a06b2e16654d3f35a55 in term 1.
I20260808 05:08:00.702540 14715 raft_consensus.cc:2454] T 37313212585b4d4d8a18402d54ff3a24 P 3a65877bfaa54e0785ae4926bc5dc775 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a71c390216b4a06b2e16654d3f35a55 in term 1.
I20260808 05:08:00.702651 14212 leader_election.cc:302] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a71c390216b4a06b2e16654d3f35a55, 9331cf6d7e8849b39541df67b6670adc; no voters:
I20260808 05:08:00.702751 14818 raft_consensus.cc:2781] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:00.702913 14818 raft_consensus.cc:686] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [term 1 LEADER]: Becoming Leader. State: Replica: 4a71c390216b4a06b2e16654d3f35a55, State: Running, Role: LEADER
I20260808 05:08:00.703014 14818 consensus_queue.cc:237] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } }
I20260808 05:08:00.703894 14104 catalog_manager.cc:5495] T 37313212585b4d4d8a18402d54ff3a24 P 4a71c390216b4a06b2e16654d3f35a55 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a71c390216b4a06b2e16654d3f35a55 (127.12.251.1). New cstate: current_term: 1 leader_uuid: "4a71c390216b4a06b2e16654d3f35a55" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a71c390216b4a06b2e16654d3f35a55" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a65877bfaa54e0785ae4926bc5dc775" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46489 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9331cf6d7e8849b39541df67b6670adc" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35565 } health_report { overall_health: UNKNOWN } } }
W20260808 05:08:00.713593 14574 tablet.cc:2369] T 37313212585b4d4d8a18402d54ff3a24 P 9331cf6d7e8849b39541df67b6670adc: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165679, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:00.718613 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.711745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49038 (local address 127.12.251.1:33993)
0808 05:08:00.711805 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.711807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.711886 (+ 79us) server_negotiation.cc:407] Connection header received
0808 05:08:00.711947 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.711948 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.711960 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.712010 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.712596 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.713049 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.713925 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.714111 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.714164 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.716361 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.716369 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.716369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.716375 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.717701 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.718006 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.718009 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.718009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.718061 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.718190 (+ 129us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.718191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.718191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.718314 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.718421 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.718489 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.718550 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:00.741777 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.735020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49050 (local address 127.12.251.1:33993)
0808 05:08:00.735086 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.735088 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.735150 (+ 62us) server_negotiation.cc:407] Connection header received
0808 05:08:00.735220 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.735221 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.735231 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.735277 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.735833 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.736315 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.737006 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.737201 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.737275 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.739337 (+ 2062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.739339 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.739339 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.739347 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.740688 (+ 1341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.740996 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.740998 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.740998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.741055 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.741241 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.741242 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.741242 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.741337 (+ 95us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.741425 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.741611 (+ 186us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.741686 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14043](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165680, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:00.763579 14804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:00.757333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49052 (local address 127.12.251.1:33993)
0808 05:08:00.757420 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:00.757422 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:00.757455 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:08:00.757532 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:00.757533 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:00.757543 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:00.757590 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:00.758113 (+ 523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.758573 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.759256 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:00.759446 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:00.759498 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:00.761512 (+ 2014us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:00.761513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:00.761513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:00.761520 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:00.762751 (+ 1231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.763025 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.763026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.763026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.763078 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:00.763235 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:00.763236 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:00.763236 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:00.763314 (+ 78us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:00.763412 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:00.763458 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:08:00.763514 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260808 05:08:00.764258 14250 tablet_service.cc:2908] Rejecting scan request for tablet 37313212585b4d4d8a18402d54ff3a24: Uninitialized: clean time has not yet been initialized
I20260808 05:08:00.765143 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14190
I20260808 05:08:00.777376 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14390
I20260808 05:08:00.789740 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14580
I20260808 05:08:00.797137 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14060
2026-08-08T05:08:00Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2059 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14836](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14836](info): set up 2 sockets
Aug 08 05:08:00 dist-test-slave-bndk krb5kdc[14836](info): commencing operation
krb5kdc: starting...
W20260808 05:08:01.935670 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:02.053511 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39181
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:39181
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:02.134884 14855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:02.135088 14855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:02.135109 14855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:02.136237 14855 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:02.136278 14855 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:08:02.136291 14855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:02.136302 14855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:02.136313 14855 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:02.136324 14855 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:02.137882 14855 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:39181
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39181
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:02.138119 14855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:02.138334 14855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:02.143118 14863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:02.143162 14861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:02.143219 14855 server_base.cc:1034] running on GCE node
W20260808 05:08:02.143406 14866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:02.143630 14855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:02.143908 14855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:02.145051 14855 hybrid_clock.cc:648] HybridClock initialized: now 1786165682145017 us; error 50 us; skew 500 ppm
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:02.150107 14855 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:02.150525 14855 webserver.cc:460] Webserver started at http://127.12.251.62:46005/ using document root <none> and password file <none>
I20260808 05:08:02.150729 14855 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:02.150776 14855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:02.150907 14855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:02.151943 14855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "1bc4f25e4d144c85a4cafe107589b38b"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "0b72a6d6ad6600f232b42efd522a29e1"
server_key_iv: "4a59e6768c42544063c8dd6ad869f4b1"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.152276 14855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "1bc4f25e4d144c85a4cafe107589b38b"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "0b72a6d6ad6600f232b42efd522a29e1"
server_key_iv: "4a59e6768c42544063c8dd6ad869f4b1"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.153612 14855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:08:02.154309 14876 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.154464 14855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:02.154548 14855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "1bc4f25e4d144c85a4cafe107589b38b"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "0b72a6d6ad6600f232b42efd522a29e1"
server_key_iv: "4a59e6768c42544063c8dd6ad869f4b1"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.154609 14855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:02.169713 14855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:02.171411 14855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:02.171542 14855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:02.176309 14855 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:39181
I20260808 05:08:02.176380 14968 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:39181 every 8 connection(s)
I20260808 05:08:02.176673 14855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:02.177341 14969 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:02.178062 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14855
I20260808 05:08:02.178162 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:02.178330 13292 external_mini_cluster.cc:1428] Setting key 21588cfc874c2ad8189e04d7780003cb
I20260808 05:08:02.180156 14969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b: Bootstrap starting.
I20260808 05:08:02.180694 14969 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:02.180975 14969 log.cc:824] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:02.181624 14969 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b: No bootstrap required, opened a new log
I20260808 05:08:02.183530 14969 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc4f25e4d144c85a4cafe107589b38b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39181 } }
I20260808 05:08:02.183667 14969 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:02.183703 14969 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bc4f25e4d144c85a4cafe107589b38b, State: Initialized, Role: FOLLOWER
I20260808 05:08:02.183856 14969 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc4f25e4d144c85a4cafe107589b38b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39181 } }
I20260808 05:08:02.183935 14969 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:02.183959 14969 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:02.184003 14969 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 0 FOLLOWER]: Advancing to term 1
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:02.184530 14969 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc4f25e4d144c85a4cafe107589b38b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39181 } }
I20260808 05:08:02.184618 14969 leader_election.cc:302] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1bc4f25e4d144c85a4cafe107589b38b; no voters:
I20260808 05:08:02.184773 14969 leader_election.cc:288] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:02.184823 14976 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:02.184965 14976 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [term 1 LEADER]: Becoming Leader. State: Replica: 1bc4f25e4d144c85a4cafe107589b38b, State: Running, Role: LEADER
I20260808 05:08:02.185025 14969 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:02.185058 14976 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc4f25e4d144c85a4cafe107589b38b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39181 } }
I20260808 05:08:02.185396 14976 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1bc4f25e4d144c85a4cafe107589b38b. Latest consensus state: current_term: 1 leader_uuid: "1bc4f25e4d144c85a4cafe107589b38b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc4f25e4d144c85a4cafe107589b38b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39181 } } }
I20260808 05:08:02.185504 14976 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:02.185406 14977 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1bc4f25e4d144c85a4cafe107589b38b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1bc4f25e4d144c85a4cafe107589b38b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39181 } } }
I20260808 05:08:02.185745 14977 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:02.186484 14988 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:02.186996 14988 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:02.188371 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.178827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51006 (local address 127.12.251.62:39181)
0808 05:08:02.179014 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.179023 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.179048 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:08:02.179453 (+ 405us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.179459 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.179505 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.179626 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.180229 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.181174 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.181950 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.182349 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.182443 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.184694 (+ 2251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.184699 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.184699 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.184713 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.186772 (+ 2059us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.187130 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.187134 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.187134 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.187225 (+ 91us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.187412 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.187412 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.187413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.187641 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.187762 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.188110 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.188227 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":80,"threads_started":1}
I20260808 05:08:02.192723 14988 catalog_manager.cc:1347] Generated new cluster ID: b2323312a5f44a1a9d79cd907cf8c86a
I20260808 05:08:02.192770 14988 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:02.202857 14988 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:02.203564 14988 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:02.212157 14988 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b: Generated new TSK 0
I20260808 05:08:02.212363 14988 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:02.242049 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39181
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:02.321650 15007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:02.321847 15007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:02.321878 15007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:02.322988 15007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:02.323027 15007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:02.323053 15007 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:02.323077 15007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:02.324468 15007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:39181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:02.324685 15007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:02.324883 15007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:02.329501 15012 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:02.329535 15016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:02.329694 15007 server_base.cc:1034] running on GCE node
W20260808 05:08:02.329761 15018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:02.329978 15007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:02.330194 15007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:02.331338 15007 hybrid_clock.cc:648] HybridClock initialized: now 1786165682331321 us; error 33 us; skew 500 ppm
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:02.333745 15007 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:02.334138 15007 webserver.cc:460] Webserver started at http://127.12.251.1:42161/ using document root <none> and password file <none>
I20260808 05:08:02.334326 15007 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:02.334371 15007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:02.334494 15007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:02.335466 15007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "668f8cb380be401b8f373eaf961c7ba1"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "d4e83fd7fe48875c8da9934332d79e69"
server_key_iv: "dec378770561444126513328508225d6"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.335796 15007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "668f8cb380be401b8f373eaf961c7ba1"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "d4e83fd7fe48875c8da9934332d79e69"
server_key_iv: "dec378770561444126513328508225d6"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.336998 15007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:08:02.337667 15032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.337816 15007 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.337915 15007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "668f8cb380be401b8f373eaf961c7ba1"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "d4e83fd7fe48875c8da9934332d79e69"
server_key_iv: "dec378770561444126513328508225d6"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.337978 15007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:02.353884 15007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:02.356187 15007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:02.356328 15007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:02.356845 15007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:02.356892 15007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.356925 15007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:02.356957 15007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.363495 15007 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:39643
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:02.363575 15204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:39643 every 8 connection(s)
I20260808 05:08:02.363859 15007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:02.366302 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.357448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:53119 (local address 127.12.251.62:39181)
0808 05:08:02.357490 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.357492 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.357753 (+ 261us) server_negotiation.cc:407] Connection header received
0808 05:08:02.358307 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.358308 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.358322 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.358376 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.358968 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.359548 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.360977 (+ 1429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.361328 (+ 351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.361426 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.364036 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.364038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.364038 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.364048 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.365249 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.365631 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.365632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.365632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.365683 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.365839 (+ 156us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.365840 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.365840 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.365934 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.365978 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.366174 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.366237 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:02.366485 15041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.357467 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39181 (local address 127.12.251.1:53119)
0808 05:08:02.357620 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.357656 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.358165 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.358455 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.358458 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.358691 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:02.358880 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.358884 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.359636 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.359637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.360879 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.360883 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.361449 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.361450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.361592 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.362524 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:02.362532 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:02.363952 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:02.365324 (+ 1372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.365331 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.365332 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.365576 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.365720 (+ 144us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.365720 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.365721 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.365802 (+ 81us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.365976 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:02.365980 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:02.366083 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.366159 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.366270 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
I20260808 05:08:02.366868 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 15007
I20260808 05:08:02.366978 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:02.367146 13292 external_mini_cluster.cc:1428] Setting key fec215fdd462ad76a783b96918fdb443
I20260808 05:08:02.367856 15205 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39181
I20260808 05:08:02.367931 15205 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:02.368168 15205 heartbeater.cc:511] Master 127.12.251.62:39181 requested a full tablet report, sending...
I20260808 05:08:02.368677 14903 ts_manager.cc:194] Registered new tserver with Master: 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643)
I20260808 05:08:02.369524 14903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:53119
I20260808 05:08:02.374543 15212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.368018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39181 (local address 127.12.251.1:54125)
0808 05:08:02.368140 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.368150 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.368270 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.369716 (+ 1446us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.369717 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.369927 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:02.369989 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.369991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.370595 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.370596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.371097 (+ 501us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.371098 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.371478 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.371479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.371541 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.371890 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:02.371894 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:02.372137 (+ 243us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:02.373699 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.373700 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.373700 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.373858 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.374057 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.374058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.374058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.374106 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.374330 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:02.374330 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:02.374364 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.374410 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.374480 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":7,"thread_start_us":73,"threads_started":1}
I20260808 05:08:02.374594 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.368017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:54125 (local address 127.12.251.62:39181)
0808 05:08:02.368056 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.368057 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.368218 (+ 161us) server_negotiation.cc:407] Connection header received
0808 05:08:02.368331 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.368331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.368342 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.368401 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.370061 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.370512 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.371164 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.371410 (+ 246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.371471 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.372214 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.372216 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.372216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.372223 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.373625 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.373937 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.373939 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.373939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.373998 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.374155 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.374155 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.374156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.374275 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.374343 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.374437 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.374509 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:02.393939 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39181
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:02.473901 15216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:02.474102 15216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:02.474125 15216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:02.475247 15216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:02.475286 15216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:02.475306 15216 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:02.475322 15216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:02.476712 15216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:39181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15216
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:02.476913 15216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:02.477133 15216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:02.481882 15229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:02.481882 15225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:02.481951 15224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:02.481986 15216 server_base.cc:1034] running on GCE node
I20260808 05:08:02.482292 15216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:02.482506 15216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:02.483637 15216 hybrid_clock.cc:648] HybridClock initialized: now 1786165682483625 us; error 27 us; skew 500 ppm
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:02.486078 15216 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:02.486544 15216 webserver.cc:460] Webserver started at http://127.12.251.2:43921/ using document root <none> and password file <none>
I20260808 05:08:02.486745 15216 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:02.486794 15216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:02.486927 15216 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:02.487967 15216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "6e491a7350d64c69b5a1658b4b0ac7a0"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "d7d29913c9b06c5efabc19ae04c44bdd"
server_key_iv: "b5d65c70ce363fe3ee5f2ca5fb58c01e"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.488297 15216 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "6e491a7350d64c69b5a1658b4b0ac7a0"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "d7d29913c9b06c5efabc19ae04c44bdd"
server_key_iv: "b5d65c70ce363fe3ee5f2ca5fb58c01e"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.489548 15216 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:08:02.490207 15244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.490350 15216 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:02.490438 15216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "6e491a7350d64c69b5a1658b4b0ac7a0"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "d7d29913c9b06c5efabc19ae04c44bdd"
server_key_iv: "b5d65c70ce363fe3ee5f2ca5fb58c01e"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.490502 15216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:02.504387 15216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:02.505996 15216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:02.506125 15216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:02.506592 15216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:02.506630 15216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.506659 15216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:02.506675 15216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.512751 15216 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:37817
I20260808 05:08:02.512835 15421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:37817 every 8 connection(s)
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:02.513113 15216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:02.515530 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.506998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:40983 (local address 127.12.251.62:39181)
0808 05:08:02.507067 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.507070 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.507219 (+ 149us) server_negotiation.cc:407] Connection header received
0808 05:08:02.507658 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.507660 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.507674 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.507753 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.508478 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.509263 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.510661 (+ 1398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.510972 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.511049 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.513483 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.513484 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.513485 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.513493 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.514537 (+ 1044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.514872 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.514873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.514873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.514917 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.515090 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.515090 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.515090 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.515178 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.515222 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.515414 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.515468 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:08:02.515674 15258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.506954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39181 (local address 127.12.251.2:40983)
0808 05:08:02.507100 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.507138 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.507571 (+ 433us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.507801 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.507804 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.508085 (+ 281us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:02.508375 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.508381 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.509369 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.509370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.510571 (+ 1201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.510574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.511055 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.511056 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.511195 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.511726 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:02.511736 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:02.513383 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:02.514602 (+ 1219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.514608 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.514609 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.514816 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.514965 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.514966 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.514966 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.515050 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.515223 (+ 173us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:02.515226 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:02.515324 (+ 98us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.515394 (+ 70us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.515504 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":81,"threads_started":1}
I20260808 05:08:02.516117 15422 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39181
I20260808 05:08:02.516199 15422 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:02.516360 15422 heartbeater.cc:511] Master 127.12.251.62:39181 requested a full tablet report, sending...
I20260808 05:08:02.516769 14902 ts_manager.cc:194] Registered new tserver with Master: 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2:37817)
I20260808 05:08:02.517257 14902 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:40983
I20260808 05:08:02.518560 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 15216
I20260808 05:08:02.518651 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:02.518813 13292 external_mini_cluster.cc:1428] Setting key fdf8b339e39a4674d09633842eee61f7
I20260808 05:08:02.522346 15436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.517030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39181 (local address 127.12.251.2:49399)
0808 05:08:02.517147 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.517156 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.517206 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.517357 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.517358 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.517564 (+ 206us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:02.517621 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.517623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.518237 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.518238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.518928 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.518930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.519288 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.519289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.519362 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.519719 (+ 357us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:02.519724 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:02.519978 (+ 254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:02.521427 (+ 1449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.521428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.521428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.521630 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.521814 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.521815 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.521815 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.521864 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.522139 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:02.522139 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:02.522172 (+ 33us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.522217 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.522283 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":68,"threads_started":1}
I20260808 05:08:02.522389 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.517096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:49399 (local address 127.12.251.62:39181)
0808 05:08:02.517131 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.517132 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.517198 (+ 66us) server_negotiation.cc:407] Connection header received
0808 05:08:02.517282 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.517283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.517297 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.517344 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.517693 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.518146 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.519001 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.519227 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.519279 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.520057 (+ 778us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.520058 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.520059 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.520065 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.521355 (+ 1290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.521698 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.521699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.521699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.521758 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.521913 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.521914 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.521915 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.522086 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.522149 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.522239 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.522311 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:02.543396 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39181
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41573
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:02.623454 15439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:02.623644 15439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:02.623675 15439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:02.624780 15439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:02.624819 15439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:02.624846 15439 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:02.624869 15439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:02.626277 15439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41573
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:39181
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:02.626502 15439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:02.626703 15439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:02.631390 15452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:02.631407 15449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:02.631407 15448 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:02.631501 15439 server_base.cc:1034] running on GCE node
I20260808 05:08:02.631803 15439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:02.631994 15439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:02.633119 15439 hybrid_clock.cc:648] HybridClock initialized: now 1786165682633104 us; error 34 us; skew 500 ppm
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:02.635493 15439 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:02.635859 15439 webserver.cc:460] Webserver started at http://127.12.251.3:32769/ using document root <none> and password file <none>
I20260808 05:08:02.636029 15439 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:02.636065 15439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:02.636155 15439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:02.637127 15439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "4a5c81a14f49469582ebee29129076dd"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "5497b9cdd3ce4ba809043be38229c797"
server_key_iv: "cdce5e00f720553a96bfa058b4b212e0"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.637501 15439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "4a5c81a14f49469582ebee29129076dd"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "5497b9cdd3ce4ba809043be38229c797"
server_key_iv: "cdce5e00f720553a96bfa058b4b212e0"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.638674 15439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:02.639289 15460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.639477 15439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:02.639568 15439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "4a5c81a14f49469582ebee29129076dd"
format_stamp: "Formatted at 2026-08-08 05:08:02 on dist-test-slave-bndk"
server_key: "5497b9cdd3ce4ba809043be38229c797"
server_key_iv: "cdce5e00f720553a96bfa058b4b212e0"
server_key_version: "encryptionkey@0"
I20260808 05:08:02.639627 15439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:02.647434 15439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:02.649333 15439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:02.649466 15439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:02.649914 15439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:02.649955 15439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.649983 15439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:02.650007 15439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:02.656828 15439 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:45361
I20260808 05:08:02.656889 15633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:45361 every 8 connection(s)
I20260808 05:08:02.657171 15439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:02.657852 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 15439
I20260808 05:08:02.657931 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:02.658109 13292 external_mini_cluster.cc:1428] Setting key 7ebd93e7f9e46182232e11c9a803edbd
I20260808 05:08:02.659847 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.650359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:42639 (local address 127.12.251.62:39181)
0808 05:08:02.650413 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.650416 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.650627 (+ 211us) server_negotiation.cc:407] Connection header received
0808 05:08:02.651246 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.651247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.651258 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.651329 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.652164 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.652917 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.654371 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.654628 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.654685 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.657147 (+ 2462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.657149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.657149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.657157 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.658760 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.659151 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.659152 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.659153 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.659208 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.659388 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.659388 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.659389 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.659486 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.659532 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.659720 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.659779 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:08:02.660033 15472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.650323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39181 (local address 127.12.251.3:42639)
0808 05:08:02.650490 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.650537 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.651140 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.651402 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.651407 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.651749 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:02.652065 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.652073 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.653017 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.653018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.654290 (+ 1272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.654293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.654716 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.654717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.654874 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.655302 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:02.655311 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:02.657061 (+ 1750us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:02.658855 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.658862 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.658864 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.659093 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.659259 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.659260 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.659260 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.659350 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.659528 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:02.659532 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:02.659632 (+ 100us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.659705 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.659816 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":80,"threads_started":1}
I20260808 05:08:02.660446 15634 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39181
I20260808 05:08:02.660528 15634 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:02.660694 15634 heartbeater.cc:511] Master 127.12.251.62:39181 requested a full tablet report, sending...
I20260808 05:08:02.661064 14903 ts_manager.cc:194] Registered new tserver with Master: 4a5c81a14f49469582ebee29129076dd (127.12.251.3:45361)
I20260808 05:08:02.661506 14903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:42639
I20260808 05:08:02.666133 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.661500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:52681 (local address 127.12.251.62:39181)
0808 05:08:02.661540 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.661542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.661652 (+ 110us) server_negotiation.cc:407] Connection header received
0808 05:08:02.661718 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.661719 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.661728 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.661764 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.662060 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.662513 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.663166 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.663362 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.663413 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.664132 (+ 719us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.664133 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.664134 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.664140 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.665141 (+ 1001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.665458 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.665459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.665460 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.665514 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.665677 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.665678 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.665678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.665779 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.665841 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.665977 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.666043 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:02.666148 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.661425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39181 (local address 127.12.251.3:52681)
0808 05:08:02.661594 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.661606 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.661666 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.661778 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.661779 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.661945 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:02.661994 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.661995 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.662598 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.662599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.663096 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.663098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.663420 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.663421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.663492 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.663812 (+ 320us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:02.663816 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:02.664057 (+ 241us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:02.665228 (+ 1171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.665230 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.665230 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.665396 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.665567 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:02.665568 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:02.665568 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:02.665628 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:02.665840 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:02.665841 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:02.665887 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.665948 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.666044 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":71,"threads_started":1}
I20260808 05:08:02.669674 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:02.692492 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.686237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51008 (local address 127.12.251.62:39181)
0808 05:08:02.686292 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.686294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.686320 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:08:02.686363 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.686364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.686373 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.686405 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.686991 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.687500 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.688186 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.688373 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.688429 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.690482 (+ 2053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:02.690484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:02.690484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:02.690491 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:02.691541 (+ 1050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.691826 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.691827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.691828 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.691878 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:02.692038 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:02.692039 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:02.692039 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:02.692142 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:02.692233 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.692325 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.692400 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:08:02.694093 14903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:02.695600 14903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:02.702181 15652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.697576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:45361 (local address 127.0.0.1:50440)
0808 05:08:02.697942 (+ 366us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.697953 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.698004 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.698676 (+ 672us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.698677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.698679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:02.698732 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.698734 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.699519 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.699520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.700808 (+ 1288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.700811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.701842 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.701843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.701939 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.701948 (+ 9us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.702022 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.702084 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"mutex_wait_us":35,"thread_start_us":51,"threads_started":1}
I20260808 05:08:02.702198 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.697896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40766 (local address 127.12.251.1:39643)
0808 05:08:02.698102 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.698107 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.698116 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:02.698148 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.698150 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.698162 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.698220 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:02.698409 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.699565 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.700900 (+ 1335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.701673 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.701744 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.701803 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.702053 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.702096 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":178,"thread_start_us":97,"threads_started":1}
I20260808 05:08:02.702181 15653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.697776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39643 (local address 127.0.0.1:40766)
0808 05:08:02.698048 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.698057 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.698097 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.698250 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.698253 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.698255 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:02.698322 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.698323 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.699645 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.699646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.700813 (+ 1167us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.700815 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.701840 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.701842 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.701934 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.701948 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.702022 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.702084 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"mutex_wait_us":7,"thread_start_us":41,"threads_started":1}
I20260808 05:08:02.702462 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.697747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50440 (local address 127.12.251.3:45361)
0808 05:08:02.698544 (+ 797us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.698548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.698557 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:02.698591 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.698592 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.698604 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.698667 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:02.698785 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.699447 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.700897 (+ 1450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.701673 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.701744 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.701803 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.702324 (+ 521us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.702369 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":759,"thread_start_us":93,"threads_started":1}
I20260808 05:08:02.702700 15654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.697576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:37817 (local address 127.0.0.1:39142)
0808 05:08:02.697882 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.697924 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.697993 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.698338 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.698339 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.698341 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:02.698396 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.698398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.700905 (+ 2507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.700906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.701640 (+ 734us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.701642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.702481 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.702482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.702545 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.702550 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.702597 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.702636 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":276,"thread_start_us":65,"threads_started":1}
I20260808 05:08:02.702755 15658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.697893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39142 (local address 127.12.251.2:37817)
0808 05:08:02.698187 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.698190 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.698198 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:02.698236 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.698238 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.698254 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.698326 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:02.698462 (+ 136us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.699565 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.701714 (+ 2149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.702307 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.702373 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.702433 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.702629 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.702669 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":267,"thread_start_us":77,"threads_started":1}
I20260808 05:08:02.703179 15537 tablet_service.cc:1467] Processing CreateTablet for tablet c470c42ead214f0abefba7f1e9143212 (DEFAULT_TABLE table=test-table [id=135a9303ac2643c1935224583abe4152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:02.703328 15104 tablet_service.cc:1467] Processing CreateTablet for tablet c470c42ead214f0abefba7f1e9143212 (DEFAULT_TABLE table=test-table [id=135a9303ac2643c1935224583abe4152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:02.703554 15537 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c470c42ead214f0abefba7f1e9143212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:02.703634 15104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c470c42ead214f0abefba7f1e9143212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:02.705834 15318 tablet_service.cc:1467] Processing CreateTablet for tablet c470c42ead214f0abefba7f1e9143212 (DEFAULT_TABLE table=test-table [id=135a9303ac2643c1935224583abe4152]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:02.706094 15318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c470c42ead214f0abefba7f1e9143212. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:02.706880 15661 tablet_bootstrap.cc:492] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Bootstrap starting.
I20260808 05:08:02.707845 15661 tablet_bootstrap.cc:654] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:02.708176 15661 log.cc:824] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:02.708981 15661 tablet_bootstrap.cc:492] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: No bootstrap required, opened a new log
I20260808 05:08:02.709041 15661 ts_tablet_manager.cc:1397] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:08:02.709347 15666 tablet_bootstrap.cc:492] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Bootstrap starting.
I20260808 05:08:02.709918 15666 tablet_bootstrap.cc:654] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:02.709975 15662 tablet_bootstrap.cc:492] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Bootstrap starting.
I20260808 05:08:02.710214 15666 log.cc:824] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:02.710601 15662 tablet_bootstrap.cc:654] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:02.710873 15666 tablet_bootstrap.cc:492] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: No bootstrap required, opened a new log
I20260808 05:08:02.710932 15666 ts_tablet_manager.cc:1397] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:08:02.710922 15662 log.cc:824] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:02.710992 15661 raft_consensus.cc:348] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.711155 15661 raft_consensus.cc:374] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:02.711196 15661 raft_consensus.cc:729] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5c81a14f49469582ebee29129076dd, State: Initialized, Role: FOLLOWER
I20260808 05:08:02.711338 15661 consensus_queue.cc:260] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.711613 15661 ts_tablet_manager.cc:1428] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:08:02.711688 15662 tablet_bootstrap.cc:492] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: No bootstrap required, opened a new log
I20260808 05:08:02.711750 15662 ts_tablet_manager.cc:1397] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:02.711742 15634 heartbeater.cc:503] Master 127.12.251.62:39181 was elected leader, sending a full tablet report...
I20260808 05:08:02.712733 15666 raft_consensus.cc:348] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.712916 15666 raft_consensus.cc:374] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:02.712957 15666 raft_consensus.cc:729] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e491a7350d64c69b5a1658b4b0ac7a0, State: Initialized, Role: FOLLOWER
I20260808 05:08:02.713093 15666 consensus_queue.cc:260] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.713392 15666 ts_tablet_manager.cc:1428] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 05:08:02.713464 15422 heartbeater.cc:503] Master 127.12.251.62:39181 was elected leader, sending a full tablet report...
I20260808 05:08:02.713709 15662 raft_consensus.cc:348] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.713867 15662 raft_consensus.cc:374] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:02.713907 15662 raft_consensus.cc:729] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668f8cb380be401b8f373eaf961c7ba1, State: Initialized, Role: FOLLOWER
I20260808 05:08:02.714011 15662 consensus_queue.cc:260] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.714247 15662 ts_tablet_manager.cc:1428] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:08:02.714283 15205 heartbeater.cc:503] Master 127.12.251.62:39181 was elected leader, sending a full tablet report...
W20260808 05:08:02.763710 15423 tablet.cc:2369] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:02.863891 15670 raft_consensus.cc:482] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:02.864027 15670 raft_consensus.cc:504] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.864428 15670 leader_election.cc:288] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643), 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2:37817)
W20260808 05:08:02.864580 15207 tablet.cc:2369] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:02.867311 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.864661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:56793 (local address 127.12.251.1:39643)
0808 05:08:02.864706 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.864708 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.864969 (+ 261us) server_negotiation.cc:407] Connection header received
0808 05:08:02.865021 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.865022 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.865032 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.865078 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:02.865237 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.865693 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.866637 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.866999 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.867059 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.867067 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.867210 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.867242 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:02.867316 15658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.864769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:47211 (local address 127.12.251.2:37817)
0808 05:08:02.864807 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.864808 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.864816 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:02.864844 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.864845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.864855 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.864903 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:02.865054 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.865595 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.866558 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.866981 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.867047 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.867056 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.867193 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.867230 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:02.867328 15472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.864602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:37817 (local address 127.12.251.3:47211)
0808 05:08:02.864732 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.864742 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.864789 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.864918 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.864919 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.864920 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:02.864995 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.864997 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.865666 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.865667 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.866478 (+ 811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.866481 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.867052 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.867053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.867132 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.867135 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.867181 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.867221 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"mutex_wait_us":24}
I20260808 05:08:02.867341 15673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.864606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39643 (local address 127.12.251.3:56793)
0808 05:08:02.864888 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.864899 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.864965 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.865086 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.865087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.865088 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:02.865161 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.865163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.865769 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.865770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.866556 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.866559 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.867074 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.867075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.867151 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.867154 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.867198 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.867239 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":262,"mutex_wait_us":110,"thread_start_us":115,"threads_started":1}
I20260808 05:08:02.867698 15352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c470c42ead214f0abefba7f1e9143212" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" is_pre_election: true
I20260808 05:08:02.867800 15131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c470c42ead214f0abefba7f1e9143212" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668f8cb380be401b8f373eaf961c7ba1" is_pre_election: true
I20260808 05:08:02.867867 15352 raft_consensus.cc:2454] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 0.
I20260808 05:08:02.867923 15131 raft_consensus.cc:2454] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 0.
I20260808 05:08:02.868110 15462 leader_election.cc:302] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5c81a14f49469582ebee29129076dd, 6e491a7350d64c69b5a1658b4b0ac7a0; no voters:
I20260808 05:08:02.868247 15670 raft_consensus.cc:2781] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:02.868292 15670 raft_consensus.cc:482] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:02.868312 15670 raft_consensus.cc:3037] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:02.869285 15670 raft_consensus.cc:504] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.869416 15670 leader_election.cc:288] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 election: Requested vote from peers 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643), 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2:37817)
I20260808 05:08:02.869570 15352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c470c42ead214f0abefba7f1e9143212" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0"
I20260808 05:08:02.869621 15131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c470c42ead214f0abefba7f1e9143212" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668f8cb380be401b8f373eaf961c7ba1"
I20260808 05:08:02.869649 15352 raft_consensus.cc:3037] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:02.869702 15131 raft_consensus.cc:3037] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:02.870381 15131 raft_consensus.cc:2454] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 1.
I20260808 05:08:02.870414 15352 raft_consensus.cc:2454] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 1.
I20260808 05:08:02.870539 15462 leader_election.cc:302] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5c81a14f49469582ebee29129076dd, 6e491a7350d64c69b5a1658b4b0ac7a0; no voters:
I20260808 05:08:02.870631 15670 raft_consensus.cc:2781] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:02.870795 15670 raft_consensus.cc:686] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 1 LEADER]: Becoming Leader. State: Replica: 4a5c81a14f49469582ebee29129076dd, State: Running, Role: LEADER
I20260808 05:08:02.870884 15670 consensus_queue.cc:237] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } }
I20260808 05:08:02.871731 14903 catalog_manager.cc:5495] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a5c81a14f49469582ebee29129076dd (127.12.251.3). New cstate: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:02.882108 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.879720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50450 (local address 127.12.251.3:45361)
0808 05:08:02.879769 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.879771 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.879780 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:02.879870 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.879871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.879888 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.879945 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:02.880095 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.880555 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.881340 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.881540 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.881594 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.881786 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:02.881879 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:02.881945 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.881997 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.882019 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:08:02.883788 15131 raft_consensus.cc:1261] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Refusing update from remote peer 4a5c81a14f49469582ebee29129076dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:02.884136 15674 consensus_queue.cc:1035] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:02.885861 15352 raft_consensus.cc:1261] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Refusing update from remote peer 4a5c81a14f49469582ebee29129076dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:02.886134 15670 consensus_queue.cc:1035] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:02.888172 15689 mvcc.cc:205] Tried to move back new op lower bound from 7316134637089333248 to 7316134637039779840. Current Snapshot: MvccSnapshot[applied={T|T < 7316134637089333248}]
I20260808 05:08:02.890609 14902 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:02.890715 14902 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:02.891582 14902 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b: Sending DeleteTablet for 3 replicas of tablet c470c42ead214f0abefba7f1e9143212
I20260808 05:08:02.892016 15104 tablet_service.cc:1514] Processing DeleteTablet for tablet c470c42ead214f0abefba7f1e9143212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:02 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:40766
I20260808 05:08:02.892297 15697 tablet_replica.cc:330] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: stopping tablet replica
I20260808 05:08:02.892412 14902 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51008:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:02.892522 14902 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:02.892706 15697 raft_consensus.cc:2229] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:02.892935 15697 raft_consensus.cc:2258] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:02.893630 15104 tablet_service.cc:1467] Processing CreateTablet for tablet 615c8bdc18c142338527d80a5f0b2fb8 (DEFAULT_TABLE table=test-table [id=937b08a56cf447aa9adc28ccbcb4d85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:02.893734 15104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 615c8bdc18c142338527d80a5f0b2fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:02.893998 15318 tablet_service.cc:1514] Processing DeleteTablet for tablet c470c42ead214f0abefba7f1e9143212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:02 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39142
I20260808 05:08:02.894217 15537 tablet_service.cc:1514] Processing DeleteTablet for tablet c470c42ead214f0abefba7f1e9143212 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:02 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:50440
I20260808 05:08:02.894515 15698 tablet_replica.cc:330] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: stopping tablet replica
I20260808 05:08:02.894527 15318 tablet_service.cc:1467] Processing CreateTablet for tablet 615c8bdc18c142338527d80a5f0b2fb8 (DEFAULT_TABLE table=test-table [id=937b08a56cf447aa9adc28ccbcb4d85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:02.894665 15698 raft_consensus.cc:2229] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:02.894757 15318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 615c8bdc18c142338527d80a5f0b2fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:02.894874 15699 tablet_replica.cc:330] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: stopping tablet replica
I20260808 05:08:02.894959 15699 raft_consensus.cc:2229] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:02.895080 15699 raft_consensus.cc:2258] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:02.895162 15532 tablet_service.cc:1467] Processing CreateTablet for tablet 615c8bdc18c142338527d80a5f0b2fb8 (DEFAULT_TABLE table=test-table [id=937b08a56cf447aa9adc28ccbcb4d85e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:02.895249 15532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 615c8bdc18c142338527d80a5f0b2fb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:02.896103 15666 tablet_bootstrap.cc:492] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: Bootstrap starting.
I20260808 05:08:02.896251 15662 tablet_bootstrap.cc:492] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: Bootstrap starting.
I20260808 05:08:02.896246 15698 raft_consensus.cc:2258] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:02.896744 15666 tablet_bootstrap.cc:654] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:02.896860 15662 tablet_bootstrap.cc:654] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:02.897419 15661 tablet_bootstrap.cc:492] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Bootstrap starting.
I20260808 05:08:02.897759 15666 tablet_bootstrap.cc:492] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: No bootstrap required, opened a new log
I20260808 05:08:02.897823 15661 tablet_bootstrap.cc:654] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:02.897818 15666 ts_tablet_manager.cc:1397] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:08:02.898003 15666 raft_consensus.cc:348] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.898080 15666 raft_consensus.cc:374] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:02.898101 15666 raft_consensus.cc:729] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e491a7350d64c69b5a1658b4b0ac7a0, State: Initialized, Role: FOLLOWER
I20260808 05:08:02.898145 15666 consensus_queue.cc:260] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.898231 15666 ts_tablet_manager.cc:1428] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:02.898633 15661 tablet_bootstrap.cc:492] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: No bootstrap required, opened a new log
I20260808 05:08:02.898681 15661 ts_tablet_manager.cc:1397] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:02.898857 15661 raft_consensus.cc:348] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.898926 15661 raft_consensus.cc:374] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:02.898943 15661 raft_consensus.cc:729] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5c81a14f49469582ebee29129076dd, State: Initialized, Role: FOLLOWER
I20260808 05:08:02.898980 15661 consensus_queue.cc:260] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.899057 15661 ts_tablet_manager.cc:1428] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:02.899206 15697 ts_tablet_manager.cc:1905] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:02.899395 15698 ts_tablet_manager.cc:1905] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:02.900736 15699 ts_tablet_manager.cc:1905] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:02.900867 15698 ts_tablet_manager.cc:1918] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:02.900945 15698 log.cc:1196] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/c470c42ead214f0abefba7f1e9143212
I20260808 05:08:02.901194 15698 ts_tablet_manager.cc:1939] T c470c42ead214f0abefba7f1e9143212 P 6e491a7350d64c69b5a1658b4b0ac7a0: Deleting consensus metadata
I20260808 05:08:02.901643 14878 catalog_manager.cc:4841] TS 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2:37817): tablet c470c42ead214f0abefba7f1e9143212 (table test-table [id=135a9303ac2643c1935224583abe4152]) successfully deleted
I20260808 05:08:02.901769 15662 tablet_bootstrap.cc:492] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: No bootstrap required, opened a new log
I20260808 05:08:02.901813 15662 ts_tablet_manager.cc:1397] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260808 05:08:02.901962 15662 raft_consensus.cc:348] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.902032 15662 raft_consensus.cc:374] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:02.902060 15662 raft_consensus.cc:729] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668f8cb380be401b8f373eaf961c7ba1, State: Initialized, Role: FOLLOWER
I20260808 05:08:02.902102 15662 consensus_queue.cc:260] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.902200 15662 ts_tablet_manager.cc:1428] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:02.902204 15697 ts_tablet_manager.cc:1918] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:02.902374 15699 ts_tablet_manager.cc:1918] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:02.902442 15699 log.cc:1196] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/c470c42ead214f0abefba7f1e9143212
I20260808 05:08:02.902403 15697 log.cc:1196] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/c470c42ead214f0abefba7f1e9143212
I20260808 05:08:02.902690 15699 ts_tablet_manager.cc:1939] T c470c42ead214f0abefba7f1e9143212 P 4a5c81a14f49469582ebee29129076dd: Deleting consensus metadata
I20260808 05:08:02.903096 14883 catalog_manager.cc:4841] TS 4a5c81a14f49469582ebee29129076dd (127.12.251.3:45361): tablet c470c42ead214f0abefba7f1e9143212 (table test-table [id=135a9303ac2643c1935224583abe4152]) successfully deleted
I20260808 05:08:02.903295 15697 ts_tablet_manager.cc:1939] T c470c42ead214f0abefba7f1e9143212 P 668f8cb380be401b8f373eaf961c7ba1: Deleting consensus metadata
I20260808 05:08:02.903653 14883 catalog_manager.cc:4841] TS 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643): tablet c470c42ead214f0abefba7f1e9143212 (table test-table [id=135a9303ac2643c1935224583abe4152]) successfully deleted
W20260808 05:08:02.907784 15636 tablet.cc:2369] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:02.956614 15692 raft_consensus.cc:482] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:02.956710 15692 raft_consensus.cc:504] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.957027 15692 leader_election.cc:288] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643), 4a5c81a14f49469582ebee29129076dd (127.12.251.3:45361)
I20260808 05:08:02.960162 15704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.957354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:45361 (local address 127.12.251.2:54347)
0808 05:08:02.957536 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.957544 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.957584 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.957758 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.957759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.957761 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:02.957853 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.957855 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.958567 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.958568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.959383 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.959385 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.959883 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.959884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.959964 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.959968 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.960020 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.960061 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":21,"thread_start_us":72,"threads_started":1}
I20260808 05:08:02.960167 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.957520 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:54347 (local address 127.12.251.3:45361)
0808 05:08:02.957659 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.957660 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.957667 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:02.957690 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.957691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.957698 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.957739 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:02.957944 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.958496 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.959465 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.959812 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.959873 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.959882 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.960048 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.960092 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260808 05:08:02.960603 15570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "615c8bdc18c142338527d80a5f0b2fb8" candidate_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5c81a14f49469582ebee29129076dd" is_pre_election: true
I20260808 05:08:02.960738 15570 raft_consensus.cc:2454] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e491a7350d64c69b5a1658b4b0ac7a0 in term 0.
I20260808 05:08:02.960785 15258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.957242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39643 (local address 127.12.251.2:42537)
0808 05:08:02.957283 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.957344 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.957393 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.957611 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.957612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.957615 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:02.957690 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.957692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.958625 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.958626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.959808 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.959811 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.960544 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.960545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:02.960628 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.960631 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:02.960671 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 05:08:02.960706 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 05:08:02.960855 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.957312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:42537 (local address 127.12.251.1:39643)
0808 05:08:02.957358 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.957361 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.957374 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:08:02.957467 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.957468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.957479 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.957528 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:02.957793 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.958523 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.959933 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.960458 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.960536 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:02.960545 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:02.960754 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 05:08:02.960794 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:02.960980 15249 leader_election.cc:302] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5c81a14f49469582ebee29129076dd, 6e491a7350d64c69b5a1658b4b0ac7a0; no voters:
I20260808 05:08:02.961145 15692 raft_consensus.cc:2781] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:02.961195 15692 raft_consensus.cc:482] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:02.961230 15692 raft_consensus.cc:3037] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:02.961285 15131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "615c8bdc18c142338527d80a5f0b2fb8" candidate_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668f8cb380be401b8f373eaf961c7ba1" is_pre_election: true
I20260808 05:08:02.961364 15131 raft_consensus.cc:2454] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e491a7350d64c69b5a1658b4b0ac7a0 in term 0.
I20260808 05:08:02.962023 15692 raft_consensus.cc:504] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.962123 15692 leader_election.cc:288] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [CANDIDATE]: Term 1 election: Requested vote from peers 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643), 4a5c81a14f49469582ebee29129076dd (127.12.251.3:45361)
I20260808 05:08:02.962304 15131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "615c8bdc18c142338527d80a5f0b2fb8" candidate_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668f8cb380be401b8f373eaf961c7ba1"
I20260808 05:08:02.962337 15570 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "615c8bdc18c142338527d80a5f0b2fb8" candidate_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a5c81a14f49469582ebee29129076dd"
I20260808 05:08:02.962383 15131 raft_consensus.cc:3037] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:02.962416 15570 raft_consensus.cc:3037] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:02.962983 15131 raft_consensus.cc:2454] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e491a7350d64c69b5a1658b4b0ac7a0 in term 1.
I20260808 05:08:02.963152 15249 leader_election.cc:302] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 668f8cb380be401b8f373eaf961c7ba1, 6e491a7350d64c69b5a1658b4b0ac7a0; no voters:
I20260808 05:08:02.963231 15692 raft_consensus.cc:2781] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:02.963279 15692 raft_consensus.cc:686] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 LEADER]: Becoming Leader. State: Replica: 6e491a7350d64c69b5a1658b4b0ac7a0, State: Running, Role: LEADER
I20260808 05:08:02.963287 15570 raft_consensus.cc:2454] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e491a7350d64c69b5a1658b4b0ac7a0 in term 1.
I20260808 05:08:02.963356 15692 consensus_queue.cc:237] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:02.964071 14903 catalog_manager.cc:5495] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } health_report { overall_health: UNKNOWN } } }
Aug 08 05:08:02 dist-test-slave-bndk krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:03.004993 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.997978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51024 (local address 127.12.251.62:39181)
0808 05:08:02.998043 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:02.998045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:02.998128 (+ 83us) server_negotiation.cc:407] Connection header received
0808 05:08:02.998175 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:02.998176 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:02.998186 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:02.998254 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:02.998669 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.999453 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.000113 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.000432 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.000505 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.002676 (+ 2171us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:03.002678 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:03.002678 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:03.002684 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:03.003870 (+ 1186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:03.004294 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:03.004294 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:03.004295 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:03.004337 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:03.004558 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:03.004559 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:03.004559 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:03.004664 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:03.004713 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:03.004854 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 05:08:03.004925 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:08:03.005169 15717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:02.997888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39181 (local address 127.0.0.1:51024)
0808 05:08:02.998062 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:02.998072 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:02.998130 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:02.998258 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:02.998259 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:02.998551 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:02.998606 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:02.998608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:02.999522 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:02.999522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.000044 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:03.000044 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.000501 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.000501 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.000541 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.001092 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:03.001097 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:03.002570 (+ 1473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:03.003948 (+ 1378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:03.003956 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:03.003958 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:03.004224 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:03.004424 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:03.004425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:03.004425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:03.004499 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:03.004712 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:03.004719 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:03.004771 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 05:08:03.004835 (+ 64us) client_negotiation.cc:240] Negotiation successful
0808 05:08:03.004997 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":38,"thread_start_us":84,"threads_started":1}
I20260808 05:08:03.007194 14903 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:51024:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:08:03.007483 14903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:03.009020 15318 tablet_service.cc:1467] Processing CreateTablet for tablet 30b5020e79e94d66bc77db8d2a5d665c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7f2f0982904e4291a3a5db790f56451c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:03.008996 15532 tablet_service.cc:1467] Processing CreateTablet for tablet 30b5020e79e94d66bc77db8d2a5d665c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7f2f0982904e4291a3a5db790f56451c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:03.009191 15318 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b5020e79e94d66bc77db8d2a5d665c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:03.009192 15532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b5020e79e94d66bc77db8d2a5d665c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:03.010439 15661 tablet_bootstrap.cc:492] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: Bootstrap starting.
I20260808 05:08:03.010545 15104 tablet_service.cc:1467] Processing CreateTablet for tablet 30b5020e79e94d66bc77db8d2a5d665c (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=7f2f0982904e4291a3a5db790f56451c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:03.010653 15666 tablet_bootstrap.cc:492] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: Bootstrap starting.
I20260808 05:08:03.010682 15104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 30b5020e79e94d66bc77db8d2a5d665c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:03.010758 15661 tablet_bootstrap.cc:654] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:03.011046 15666 tablet_bootstrap.cc:654] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:03.011253 15661 tablet_bootstrap.cc:492] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: No bootstrap required, opened a new log
I20260808 05:08:03.011312 15661 ts_tablet_manager.cc:1397] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:03.011418 15661 raft_consensus.cc:348] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.011485 15661 raft_consensus.cc:374] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:03.011503 15661 raft_consensus.cc:729] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a5c81a14f49469582ebee29129076dd, State: Initialized, Role: FOLLOWER
I20260808 05:08:03.011546 15661 consensus_queue.cc:260] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.011631 15661 ts_tablet_manager.cc:1428] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:03.012171 15662 tablet_bootstrap.cc:492] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: Bootstrap starting.
I20260808 05:08:03.012234 15674 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.012321 15674 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:03.012599 15662 tablet_bootstrap.cc:654] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:03.012732 15666 tablet_bootstrap.cc:492] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: No bootstrap required, opened a new log
I20260808 05:08:03.012780 15666 ts_tablet_manager.cc:1397] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:08:03.012941 15666 raft_consensus.cc:348] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.013008 15666 raft_consensus.cc:374] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:03.013021 15666 raft_consensus.cc:729] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e491a7350d64c69b5a1658b4b0ac7a0, State: Initialized, Role: FOLLOWER
I20260808 05:08:03.013057 15666 consensus_queue.cc:260] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.013144 15666 ts_tablet_manager.cc:1428] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:03.013193 15692 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.013284 15662 tablet_bootstrap.cc:492] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: No bootstrap required, opened a new log
I20260808 05:08:03.013325 15662 ts_tablet_manager.cc:1397] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:03.013315 15692 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:03.013463 15662 raft_consensus.cc:348] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.013521 15662 raft_consensus.cc:374] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:03.013533 15662 raft_consensus.cc:729] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 668f8cb380be401b8f373eaf961c7ba1, State: Initialized, Role: FOLLOWER
I20260808 05:08:03.013564 15662 consensus_queue.cc:260] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.013640 15662 ts_tablet_manager.cc:1428] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:03.013700 15672 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.013782 15672 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:03.085047 15674 raft_consensus.cc:482] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:03.085166 15674 raft_consensus.cc:504] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.085357 15674 leader_election.cc:288] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643), 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2:37817)
I20260808 05:08:03.085561 15131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b5020e79e94d66bc77db8d2a5d665c" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668f8cb380be401b8f373eaf961c7ba1" is_pre_election: true
I20260808 05:08:03.085564 15352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b5020e79e94d66bc77db8d2a5d665c" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" is_pre_election: true
I20260808 05:08:03.085666 15352 raft_consensus.cc:2454] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 0.
I20260808 05:08:03.085656 15131 raft_consensus.cc:2454] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 0.
I20260808 05:08:03.085825 15465 leader_election.cc:302] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5c81a14f49469582ebee29129076dd, 668f8cb380be401b8f373eaf961c7ba1; no voters:
I20260808 05:08:03.085930 15674 raft_consensus.cc:2781] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:03.085973 15674 raft_consensus.cc:482] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:03.086016 15674 raft_consensus.cc:3037] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:03.086796 15674 raft_consensus.cc:504] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.086918 15674 leader_election.cc:288] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 election: Requested vote from peers 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643), 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2:37817)
I20260808 05:08:03.087044 15131 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b5020e79e94d66bc77db8d2a5d665c" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "668f8cb380be401b8f373eaf961c7ba1"
I20260808 05:08:03.087065 15352 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "30b5020e79e94d66bc77db8d2a5d665c" candidate_uuid: "4a5c81a14f49469582ebee29129076dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0"
I20260808 05:08:03.087112 15131 raft_consensus.cc:3037] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:03.087123 15352 raft_consensus.cc:3037] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:03.087674 15352 raft_consensus.cc:2454] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 1.
I20260808 05:08:03.087759 15131 raft_consensus.cc:2454] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a5c81a14f49469582ebee29129076dd in term 1.
I20260808 05:08:03.087836 15462 leader_election.cc:302] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a5c81a14f49469582ebee29129076dd, 6e491a7350d64c69b5a1658b4b0ac7a0; no voters:
I20260808 05:08:03.087935 15674 raft_consensus.cc:2781] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:03.087988 15674 raft_consensus.cc:686] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [term 1 LEADER]: Becoming Leader. State: Replica: 4a5c81a14f49469582ebee29129076dd, State: Running, Role: LEADER
I20260808 05:08:03.088035 15674 consensus_queue.cc:237] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } }
I20260808 05:08:03.088320 15670 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: TxnStatusTablet state changed. Reason: New leader 4a5c81a14f49469582ebee29129076dd. Latest consensus state: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.088397 15670 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:03.088578 15723 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:08:03.088644 14903 catalog_manager.cc:5495] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a5c81a14f49469582ebee29129076dd (127.12.251.3). New cstate: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } health_report { overall_health: HEALTHY } } }
I20260808 05:08:03.088727 15723 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:08:03.104708 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.102480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50462 (local address 127.12.251.3:45361)
0808 05:08:03.102531 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:03.102534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:03.102544 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:03.102628 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:03.102629 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:03.102638 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:03.102688 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:03.102831 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.103309 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.104054 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.104248 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.104299 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.104466 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:03.104502 (+ 36us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:03.104551 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:03.104615 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 05:08:03.104636 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:08:03.104727 15717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.102428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:45361 (local address 127.0.0.1:50462)
0808 05:08:03.102507 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:03.102517 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:03.102560 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:03.102714 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:03.102716 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:03.102717 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:03.102769 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:03.102772 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.103376 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.103377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.103969 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:03.103971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.104304 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.104305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.104375 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.104390 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:03.104561 (+ 171us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:03.104569 (+ 8us) client_negotiation.cc:769] Sending connection context
0808 05:08:03.104611 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:08:03.104661 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:08:03.105990 15131 raft_consensus.cc:1261] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Refusing update from remote peer 4a5c81a14f49469582ebee29129076dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:03.106122 15352 raft_consensus.cc:1261] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Refusing update from remote peer 4a5c81a14f49469582ebee29129076dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:03.106212 15670 consensus_queue.cc:1035] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:03.106328 15670 consensus_queue.cc:1035] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:03.107010 15672 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: TxnStatusTablet state changed. Reason: New leader 4a5c81a14f49469582ebee29129076dd. Latest consensus state: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.107105 15672 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:03.107163 15692 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: TxnStatusTablet state changed. Reason: New leader 4a5c81a14f49469582ebee29129076dd. Latest consensus state: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.107232 15692 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:03.107312 15682 mvcc.cc:205] Tried to move back new op lower bound from 7316134638000324608 to 7316134637928886272. Current Snapshot: MvccSnapshot[applied={T|T < 7316134638000324608}]
I20260808 05:08:03.107391 15674 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.107473 15674 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:03.107472 15670 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.107575 15670 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 4a5c81a14f49469582ebee29129076dd: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:03.107975 15683 mvcc.cc:205] Tried to move back new op lower bound from 7316134638000324608 to 7316134637928886272. Current Snapshot: MvccSnapshot[applied={T|T < 7316134638000324608}]
I20260808 05:08:03.108172 15692 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.108240 15692 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 6e491a7350d64c69b5a1658b4b0ac7a0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:03.108423 15672 tablet_replica.cc:439] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4a5c81a14f49469582ebee29129076dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 } } peers { permanent_uuid: "6e491a7350d64c69b5a1658b4b0ac7a0" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37817 } } peers { permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 } } }
I20260808 05:08:03.108489 15672 tablet_replica.cc:442] T 30b5020e79e94d66bc77db8d2a5d665c P 668f8cb380be401b8f373eaf961c7ba1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:03.112669 15658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.110499 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39156 (local address 127.12.251.2:37817)
0808 05:08:03.110536 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:03.110537 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:03.110569 (+ 32us) server_negotiation.cc:407] Connection header received
0808 05:08:03.110642 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:03.110643 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:03.110663 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:03.110725 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:03.110821 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.111276 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.111981 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.112181 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.112231 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.112374 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:03.112484 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:03.112544 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:03.112584 (+ 40us) server_negotiation.cc:299] Negotiation successful
0808 05:08:03.112603 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:03.117740 15655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.115019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:48379 (local address 127.12.251.3:45361)
0808 05:08:03.115059 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:03.115061 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:03.115212 (+ 151us) server_negotiation.cc:407] Connection header received
0808 05:08:03.115272 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:03.115273 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:03.115282 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:03.115324 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:03.115522 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.116036 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.117110 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.117327 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.117374 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.117553 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:03.117576 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:03.117605 (+ 29us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:03.117676 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 05:08:03.117691 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:08:03.117816 15733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.114957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:45361 (local address 127.12.251.2:48379)
0808 05:08:03.115142 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:03.115154 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:03.115219 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:03.115342 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:03.115343 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:03.115344 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:03.115463 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:03.115465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.116096 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.116097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.117039 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:03.117042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.117393 (+ 351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.117394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.117461 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.117476 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:03.117629 (+ 153us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:03.117630 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:03.117674 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:08:03.117723 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260808 05:08:03.120098 15131 raft_consensus.cc:1261] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Refusing update from remote peer 6e491a7350d64c69b5a1658b4b0ac7a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:03.120222 15570 raft_consensus.cc:1261] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Refusing update from remote peer 6e491a7350d64c69b5a1658b4b0ac7a0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:03.120333 15671 consensus_queue.cc:1035] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "668f8cb380be401b8f373eaf961c7ba1" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:03.120448 15692 consensus_queue.cc:1035] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a5c81a14f49469582ebee29129076dd" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:03.130227 15658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.127765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:35491 (local address 127.12.251.2:37817)
0808 05:08:03.127821 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:03.127822 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:03.127829 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:03.127847 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:03.127847 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:03.127855 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:03.127899 (+ 44us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:03.128044 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.128508 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.129576 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.129847 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.129898 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.130058 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:03.130081 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:03.130113 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:03.130162 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 05:08:03.130178 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:08:03.130275 15641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.127572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:37817 (local address 127.12.251.3:35491)
0808 05:08:03.127653 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:03.127663 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:03.127698 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:03.127921 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:03.127922 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:03.127923 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:03.127987 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:03.127989 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.128575 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.128576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.129505 (+ 929us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:03.129508 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.129912 (+ 404us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.129912 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:03.129969 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.129984 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:03.130115 (+ 131us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:03.130116 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:03.130160 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:08:03.130200 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260808 05:08:03.139189 14903 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:03.139290 14903 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51008:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:03.139839 14903 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1bc4f25e4d144c85a4cafe107589b38b: Sending DeleteTablet for 3 replicas of tablet 615c8bdc18c142338527d80a5f0b2fb8
I20260808 05:08:03.140151 15318 tablet_service.cc:1514] Processing DeleteTablet for tablet 615c8bdc18c142338527d80a5f0b2fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:03 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39142
I20260808 05:08:03.140266 15104 tablet_service.cc:1514] Processing DeleteTablet for tablet 615c8bdc18c142338527d80a5f0b2fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:03 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:40766
I20260808 05:08:03.140324 15698 tablet_replica.cc:330] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: stopping tablet replica
I20260808 05:08:03.140349 15697 tablet_replica.cc:330] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: stopping tablet replica
I20260808 05:08:03.140388 15698 raft_consensus.cc:2229] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:03.140401 15697 raft_consensus.cc:2229] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:03.140434 15697 raft_consensus.cc:2258] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:03.140468 15698 raft_consensus.cc:2258] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:03.140724 15532 tablet_service.cc:1514] Processing DeleteTablet for tablet 615c8bdc18c142338527d80a5f0b2fb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:03 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:50440
I20260808 05:08:03.140797 15697 ts_tablet_manager.cc:1905] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:03.140798 15698 ts_tablet_manager.cc:1905] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:03.140813 15699 tablet_replica.cc:330] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: stopping tablet replica
I20260808 05:08:03.140878 15699 raft_consensus.cc:2229] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:03.140908 15699 raft_consensus.cc:2258] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:03.141165 15699 ts_tablet_manager.cc:1905] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:03.142565 15697 ts_tablet_manager.cc:1918] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:03.142580 15698 ts_tablet_manager.cc:1918] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:03.142623 15697 log.cc:1196] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/615c8bdc18c142338527d80a5f0b2fb8
I20260808 05:08:03.142622 15698 log.cc:1196] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/615c8bdc18c142338527d80a5f0b2fb8
I20260808 05:08:03.142838 15698 ts_tablet_manager.cc:1939] T 615c8bdc18c142338527d80a5f0b2fb8 P 6e491a7350d64c69b5a1658b4b0ac7a0: Deleting consensus metadata
I20260808 05:08:03.142838 15697 ts_tablet_manager.cc:1939] T 615c8bdc18c142338527d80a5f0b2fb8 P 668f8cb380be401b8f373eaf961c7ba1: Deleting consensus metadata
I20260808 05:08:03.142832 15699 ts_tablet_manager.cc:1918] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:03.142894 15699 log.cc:1196] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/615c8bdc18c142338527d80a5f0b2fb8
I20260808 05:08:03.143087 15699 ts_tablet_manager.cc:1939] T 615c8bdc18c142338527d80a5f0b2fb8 P 4a5c81a14f49469582ebee29129076dd: Deleting consensus metadata
I20260808 05:08:03.143122 14883 catalog_manager.cc:4841] TS 668f8cb380be401b8f373eaf961c7ba1 (127.12.251.1:39643): tablet 615c8bdc18c142338527d80a5f0b2fb8 (table test-table [id=937b08a56cf447aa9adc28ccbcb4d85e]) successfully deleted
I20260808 05:08:03.143265 14878 catalog_manager.cc:4841] TS 6e491a7350d64c69b5a1658b4b0ac7a0 (127.12.251.2:37817): tablet 615c8bdc18c142338527d80a5f0b2fb8 (table test-table [id=937b08a56cf447aa9adc28ccbcb4d85e]) successfully deleted
I20260808 05:08:03.143369 14883 catalog_manager.cc:4841] TS 4a5c81a14f49469582ebee29129076dd (127.12.251.3:45361): tablet 615c8bdc18c142338527d80a5f0b2fb8 (table test-table [id=937b08a56cf447aa9adc28ccbcb4d85e]) successfully deleted
Aug 08 05:08:03 dist-test-slave-bndk krb5kdc[14836](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165682, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:03.152882 15660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.141198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40774 (local address 127.12.251.1:39643)
0808 05:08:03.141278 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:03.141280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:03.145379 (+ 4099us) server_negotiation.cc:407] Connection header received
0808 05:08:03.145433 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:03.145434 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:03.145453 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:03.145497 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:03.146015 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.146478 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.147216 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.147399 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.147458 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.150252 (+ 2794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:03.150261 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:03.150262 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:03.150268 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:03.151785 (+ 1517us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:03.152096 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:03.152099 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:03.152100 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:03.152188 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:03.152365 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:03.152366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:03.152366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:03.152502 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:03.152628 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:03.152718 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 05:08:03.152794 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
W20260808 05:08:03.153148 15198 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:40774
I20260808 05:08:03.159750 14974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:03.154065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51038 (local address 127.12.251.62:39181)
0808 05:08:03.154111 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:03.154113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:03.154165 (+ 52us) server_negotiation.cc:407] Connection header received
0808 05:08:03.154223 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:03.154224 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:03.154234 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:03.154278 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:03.154747 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.155228 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.155874 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:03.156082 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:03.156137 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:03.157350 (+ 1213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:03.157351 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:03.157351 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:03.157360 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:03.158786 (+ 1426us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:03.159084 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:03.159085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:03.159085 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:03.159140 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:03.159299 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:03.159300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:03.159301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:03.159408 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:03.159500 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:03.159589 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:08:03.159662 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:08:03.160037 14903 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:51038
I20260808 05:08:03.160672 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 15007
I20260808 05:08:03.169276 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 15216
I20260808 05:08:03.179812 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 15439
I20260808 05:08:03.195406 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14855
2026-08-08T05:08:03Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2402 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:03 dist-test-slave-bndk krb5kdc[15753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:03 dist-test-slave-bndk krb5kdc[15753](info): set up 2 sockets
Aug 08 05:08:03 dist-test-slave-bndk krb5kdc[15753](info): commencing operation
krb5kdc: starting...
W20260808 05:08:04.329756 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:04 dist-test-slave-bndk krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:04.447373 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:43021
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:43021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:04.528288 15779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:04.528505 15779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:04.528538 15779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:04.529667 15779 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:04.529706 15779 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:08:04.529723 15779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:04.529740 15779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:04.529755 15779 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:04.529771 15779 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:04.531216 15779 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:43021
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:43021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:04.531489 15779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:04.531692 15779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:04.536468 15788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:04.536444 15786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:04.536531 15779 server_base.cc:1034] running on GCE node
W20260808 05:08:04.536432 15785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:04.536867 15779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:04.537148 15779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:04.538286 15779 hybrid_clock.cc:648] HybridClock initialized: now 1786165684538269 us; error 33 us; skew 500 ppm
Aug 08 05:08:04 dist-test-slave-bndk krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:04.540589 15779 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:04.540992 15779 webserver.cc:460] Webserver started at http://127.12.251.62:35373/ using document root <none> and password file <none>
I20260808 05:08:04.541195 15779 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:04.541267 15779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:04.541401 15779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:04.542402 15779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "694ebc7b744a4244b1332d0381b1fd28"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "997f40b3ff58b19feee40d9b337bf32a"
server_key_iv: "8c988299777cd42ccbc88e0de0764a0b"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.542730 15779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "694ebc7b744a4244b1332d0381b1fd28"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "997f40b3ff58b19feee40d9b337bf32a"
server_key_iv: "8c988299777cd42ccbc88e0de0764a0b"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.543955 15779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:04.544600 15800 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:04.544760 15779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:04.544842 15779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "694ebc7b744a4244b1332d0381b1fd28"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "997f40b3ff58b19feee40d9b337bf32a"
server_key_iv: "8c988299777cd42ccbc88e0de0764a0b"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.544901 15779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:04.555970 15779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:04.557984 15779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:04.558113 15779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:04.562525 15779 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:43021
I20260808 05:08:04.562597 15891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:43021 every 8 connection(s)
I20260808 05:08:04.562857 15779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:04.563562 15895 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:04.565932 15895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Bootstrap starting.
I20260808 05:08:04.566519 15895 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:04.566787 15895 log.cc:824] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:04.567485 15895 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: No bootstrap required, opened a new log
I20260808 05:08:04.569877 15895 raft_consensus.cc:348] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "694ebc7b744a4244b1332d0381b1fd28" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43021 } }
I20260808 05:08:04.570025 15895 raft_consensus.cc:374] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:04.570047 15895 raft_consensus.cc:729] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 694ebc7b744a4244b1332d0381b1fd28, State: Initialized, Role: FOLLOWER
I20260808 05:08:04.570173 15895 consensus_queue.cc:260] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "694ebc7b744a4244b1332d0381b1fd28" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43021 } }
I20260808 05:08:04.570254 15895 raft_consensus.cc:388] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:04.570281 15895 raft_consensus.cc:482] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:04.570331 15895 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:04.570875 15895 raft_consensus.cc:504] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "694ebc7b744a4244b1332d0381b1fd28" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43021 } }
I20260808 05:08:04.570968 15895 leader_election.cc:302] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 694ebc7b744a4244b1332d0381b1fd28; no voters:
I20260808 05:08:04.571134 15895 leader_election.cc:288] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:04.571177 15900 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:04.571344 15900 raft_consensus.cc:686] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [term 1 LEADER]: Becoming Leader. State: Replica: 694ebc7b744a4244b1332d0381b1fd28, State: Running, Role: LEADER
I20260808 05:08:04.571389 15895 sys_catalog.cc:564] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:04.571434 15900 consensus_queue.cc:237] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "694ebc7b744a4244b1332d0381b1fd28" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43021 } }
I20260808 05:08:04.571815 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 15779
I20260808 05:08:04.571817 15902 sys_catalog.cc:455] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 694ebc7b744a4244b1332d0381b1fd28. Latest consensus state: current_term: 1 leader_uuid: "694ebc7b744a4244b1332d0381b1fd28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "694ebc7b744a4244b1332d0381b1fd28" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43021 } } }
I20260808 05:08:04.571884 15902 sys_catalog.cc:458] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:04.571902 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:04.572072 13292 external_mini_cluster.cc:1428] Setting key b3556a99d5729bb5c4ce27b11951d900
I20260808 05:08:04.572404 15910 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:04.572310 15901 sys_catalog.cc:455] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "694ebc7b744a4244b1332d0381b1fd28" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "694ebc7b744a4244b1332d0381b1fd28" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43021 } } }
I20260808 05:08:04.572677 15901 sys_catalog.cc:458] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:04.572950 15910 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:04.577718 15910 catalog_manager.cc:1347] Generated new cluster ID: 3fa5160bc9da4df78878d4bd92f8c2ef
I20260808 05:08:04.577762 15910 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:08:04 dist-test-slave-bndk krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:04.583012 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.572509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55922 (local address 127.12.251.62:43021)
0808 05:08:04.572791 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:04.572800 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:04.573195 (+ 395us) server_negotiation.cc:407] Connection header received
0808 05:08:04.573529 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:04.573537 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:04.573599 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:04.573735 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:04.574472 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.575322 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.576360 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.576763 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.576835 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.579474 (+ 2639us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:04.579479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:04.579479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:04.579491 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:04.581392 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.581757 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.581760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.581760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.581901 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.582073 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.582074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.582074 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.582403 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:04.582561 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:04.582642 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:08:04.582781 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":235,"thread_start_us":89,"threads_started":1}
I20260808 05:08:04.591640 15910 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:04.592132 15910 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:04.598261 15910 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Generated new TSK 0
I20260808 05:08:04.598414 15910 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:04.626053 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43021
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:04.706393 15929 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:04.706606 15929 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:04.706638 15929 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:04.707731 15929 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:04.707769 15929 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:04.707798 15929 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:08:04.707813 15929 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:04.707837 15929 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:04.709300 15929 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:43021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15929
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:04.709543 15929 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:04.709746 15929 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:04.714636 15939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:04.714627 15941 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:04.714627 15945 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:04.715018 15929 server_base.cc:1034] running on GCE node
I20260808 05:08:04.715191 15929 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:04.715394 15929 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:04.716523 15929 hybrid_clock.cc:648] HybridClock initialized: now 1786165684716506 us; error 31 us; skew 500 ppm
Aug 08 05:08:04 dist-test-slave-bndk krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:04.718963 15929 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:04.719390 15929 webserver.cc:460] Webserver started at http://127.12.251.1:37455/ using document root <none> and password file <none>
I20260808 05:08:04.719604 15929 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:04.719652 15929 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:04.719777 15929 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:04.720783 15929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "8ab3f52c368343cc840f62f3e17f4256"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "9f9d2ae127c89412a00dd303f29501d6"
server_key_iv: "4107dc9e5dc18f4f4a901baf22232f7f"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.721112 15929 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "8ab3f52c368343cc840f62f3e17f4256"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "9f9d2ae127c89412a00dd303f29501d6"
server_key_iv: "4107dc9e5dc18f4f4a901baf22232f7f"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.722358 15929 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:04.723038 15960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:04.723189 15929 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:04.723270 15929 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "8ab3f52c368343cc840f62f3e17f4256"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "9f9d2ae127c89412a00dd303f29501d6"
server_key_iv: "4107dc9e5dc18f4f4a901baf22232f7f"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.723330 15929 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:04.753355 15929 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:04.755481 15929 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:04.755615 15929 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:04.756137 15929 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:04.756179 15929 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:04.756208 15929 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:04.756237 15929 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:08:04 dist-test-slave-bndk krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:04.762813 15929 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:43635
I20260808 05:08:04.763105 16124 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:43635 every 8 connection(s)
I20260808 05:08:04.763144 15929 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:04.765158 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.756505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:45387 (local address 127.12.251.62:43021)
0808 05:08:04.756555 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:04.756558 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:04.756784 (+ 226us) server_negotiation.cc:407] Connection header received
0808 05:08:04.757357 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:04.757359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:04.757377 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:04.757447 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:04.758198 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.758786 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.759812 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.760055 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.760113 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.762587 (+ 2474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:04.762589 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:04.762589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:04.762597 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:04.764049 (+ 1452us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.764397 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.764398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.764398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.764464 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.764661 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.764662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.764662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.764759 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:04.764803 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:04.765026 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 05:08:04.765094 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:08:04.765326 15972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.756509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43021 (local address 127.12.251.1:45387)
0808 05:08:04.756665 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:04.756701 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:04.757253 (+ 552us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:04.757518 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:04.757523 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:04.757796 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:04.758107 (+ 311us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.758115 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.758883 (+ 768us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.758885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.759725 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.759727 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.760139 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.760139 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.760274 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.760725 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:04.760734 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:04.762499 (+ 1765us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:04.764126 (+ 1627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.764131 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.764132 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.764338 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.764508 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.764509 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.764509 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.764613 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.764802 (+ 189us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:04.764805 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:04.764930 (+ 125us) client_negotiation.cc:769] Sending connection context
0808 05:08:04.765008 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:08:04.765125 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":79,"threads_started":1}
I20260808 05:08:04.765815 16125 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43021
I20260808 05:08:04.765897 16125 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:04.766073 16125 heartbeater.cc:511] Master 127.12.251.62:43021 requested a full tablet report, sending...
I20260808 05:08:04.766609 15823 ts_manager.cc:194] Registered new tserver with Master: 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635)
I20260808 05:08:04.767259 15823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:45387
I20260808 05:08:04.771552 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 15929
I20260808 05:08:04.771675 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:04.771874 13292 external_mini_cluster.cc:1428] Setting key b5b700cb0de2be388a27f929d8bf2bfc
I20260808 05:08:04.771996 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.766762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:59605 (local address 127.12.251.62:43021)
0808 05:08:04.766805 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:04.766807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:04.767521 (+ 714us) server_negotiation.cc:407] Connection header received
0808 05:08:04.767586 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:04.767586 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:04.767596 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:04.767640 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:04.767937 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.768420 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.769062 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.769255 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.769315 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.770053 (+ 738us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:04.770054 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:04.770054 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:04.770058 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:04.771036 (+ 978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.771315 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.771315 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.771316 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.771358 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.771547 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.771547 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.771547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.771657 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:04.771719 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:04.771853 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 05:08:04.771911 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:04.772023 16134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.766701 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43021 (local address 127.12.251.1:59605)
0808 05:08:04.767456 (+ 755us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:04.767467 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:04.767535 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:04.767644 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:04.767645 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:04.767802 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:04.767873 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.767875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.768512 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.768513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.769003 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.769005 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.769321 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.769321 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.769382 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.769731 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:04.769736 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:04.769989 (+ 253us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:04.771101 (+ 1112us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.771102 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.771102 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.771255 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.771420 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.771420 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.771421 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.771485 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.771711 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:04.771712 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:04.771759 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 05:08:04.771833 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:08:04.771930 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":728,"thread_start_us":69,"threads_started":1}
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:04.795632 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43021
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:04.877089 16143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:04.877297 16143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:04.877331 16143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:04.878432 16143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:04.878470 16143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:04.878496 16143 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:08:04.878511 16143 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:04.878540 16143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:04.880019 16143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:43021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:04.880239 16143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:04.880457 16143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:04.885255 16151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:04.885203 16153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:04.885203 16150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:04.885577 16143 server_base.cc:1034] running on GCE node
I20260808 05:08:04.885763 16143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:04.885990 16143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:04.887136 16143 hybrid_clock.cc:648] HybridClock initialized: now 1786165684887116 us; error 32 us; skew 500 ppm
Aug 08 05:08:04 dist-test-slave-bndk krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:04.889519 16143 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:04.889933 16143 webserver.cc:460] Webserver started at http://127.12.251.2:43833/ using document root <none> and password file <none>
I20260808 05:08:04.890143 16143 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:04.890192 16143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:04.890316 16143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:04.891337 16143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "afabb5d7d63d412985b17b237e7a586b"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "9906dab28ba822a954968108f767abae"
server_key_iv: "5df9193d7d3e54aa7ed5385750b27ac5"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.891665 16143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "afabb5d7d63d412985b17b237e7a586b"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "9906dab28ba822a954968108f767abae"
server_key_iv: "5df9193d7d3e54aa7ed5385750b27ac5"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.892868 16143 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:08:04.893553 16167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:04.893697 16143 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:04.893778 16143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "afabb5d7d63d412985b17b237e7a586b"
format_stamp: "Formatted at 2026-08-08 05:08:04 on dist-test-slave-bndk"
server_key: "9906dab28ba822a954968108f767abae"
server_key_iv: "5df9193d7d3e54aa7ed5385750b27ac5"
server_key_version: "encryptionkey@0"
I20260808 05:08:04.893850 16143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:04.903250 16143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:04.904838 16143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:04.904974 16143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:04.905570 16143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:04.905612 16143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:04.905639 16143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:04.905665 16143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:08:04 dist-test-slave-bndk krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:04.912142 16143 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:36541
I20260808 05:08:04.912218 16343 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:36541 every 8 connection(s)
I20260808 05:08:04.912526 16143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:04.914688 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.905921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:35275 (local address 127.12.251.62:43021)
0808 05:08:04.905977 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:04.905980 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:04.906170 (+ 190us) server_negotiation.cc:407] Connection header received
0808 05:08:04.906646 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:04.906648 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:04.906660 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:04.906733 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:04.907315 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.908071 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.909616 (+ 1545us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.909912 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.909989 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.912211 (+ 2222us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:04.912213 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:04.912213 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:04.912221 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:04.913617 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.913981 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.913982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.913982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.914030 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.914194 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.914194 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.914194 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.914286 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:04.914329 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:04.914563 (+ 234us) server_negotiation.cc:299] Negotiation successful
0808 05:08:04.914621 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:04.914814 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.905903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43021 (local address 127.12.251.2:35275)
0808 05:08:04.906052 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:04.906091 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:04.906531 (+ 440us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:04.906804 (+ 273us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:04.906809 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:04.907043 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:04.907228 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.907233 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.908186 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.908188 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.909525 (+ 1337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.909529 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.910006 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.910007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.910142 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.910596 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:04.910606 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:04.912108 (+ 1502us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:04.913691 (+ 1583us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.913698 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.913699 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.913920 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.914069 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.914070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.914070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.914155 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.914347 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:04.914351 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:04.914456 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 05:08:04.914533 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 05:08:04.914647 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":88,"threads_started":1}
I20260808 05:08:04.915228 16345 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43021
I20260808 05:08:04.915315 16345 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:04.915489 16345 heartbeater.cc:511] Master 127.12.251.62:43021 requested a full tablet report, sending...
I20260808 05:08:04.915828 15823 ts_manager.cc:194] Registered new tserver with Master: afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541)
I20260808 05:08:04.916204 15823 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:35275
I20260808 05:08:04.920399 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 16143
I20260808 05:08:04.920497 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:04.920725 13292 external_mini_cluster.cc:1428] Setting key b32cf098a18208837ebcab22dd4d8184
I20260808 05:08:04.921134 16356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.916188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43021 (local address 127.12.251.2:47129)
0808 05:08:04.916313 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:04.916325 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:04.916380 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:04.916507 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:04.916508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:04.916657 (+ 149us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:04.916706 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.916708 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.917395 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.917396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.917887 (+ 491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:04.917888 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.918187 (+ 299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.918188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:04.918265 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.918655 (+ 390us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:04.918659 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:04.918932 (+ 273us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:04.920041 (+ 1109us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.920042 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.920042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.920217 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.920383 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:04.920384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:04.920384 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:04.920451 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:04.920845 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:04.920846 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:04.920893 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 05:08:04.920955 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:08:04.921043 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":115,"threads_started":1}
I20260808 05:08:04.921160 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:04.916268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:47129 (local address 127.12.251.62:43021)
0808 05:08:04.916306 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:04.916307 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:04.916370 (+ 63us) server_negotiation.cc:407] Connection header received
0808 05:08:04.916424 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:04.916425 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:04.916436 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:04.916503 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:04.916767 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.917309 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.917946 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:04.918113 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:04.918154 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:04.918997 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:04.918998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:04.918998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:04.919002 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:04.919972 (+ 970us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.920277 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.920277 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.920277 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.920317 (+ 40us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:04.920543 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:04.920545 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:04.920545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:04.920743 (+ 198us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:04.920793 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:04.921002 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 05:08:04.921079 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:04.943799 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43021
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45855
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:05.023128 16361 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:05.023316 16361 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:05.023339 16361 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:05.024430 16361 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:05.024466 16361 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:05.024485 16361 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260808 05:08:05.024498 16361 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:05.024528 16361 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:05.025959 16361 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45855
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:43021
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16361
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:05.026160 16361 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:05.026347 16361 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:05.031226 16368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:05.031172 16370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:05.031174 16372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:05.031203 16361 server_base.cc:1034] running on GCE node
I20260808 05:08:05.031639 16361 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:05.031848 16361 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:05.032977 16361 hybrid_clock.cc:648] HybridClock initialized: now 1786165685032968 us; error 29 us; skew 500 ppm
Aug 08 05:08:05 dist-test-slave-bndk krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165685, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:05.035291 16361 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:05.035722 16361 webserver.cc:460] Webserver started at http://127.12.251.3:32831/ using document root <none> and password file <none>
I20260808 05:08:05.035913 16361 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:05.035959 16361 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:05.036079 16361 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:05.037056 16361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "994b44b350164647a031f34e237f8ff0"
format_stamp: "Formatted at 2026-08-08 05:08:05 on dist-test-slave-bndk"
server_key: "91b06a26148197171de76c5aff736c2f"
server_key_iv: "c1943768d53c3987fa787ecd0967c335"
server_key_version: "encryptionkey@0"
I20260808 05:08:05.037401 16361 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "994b44b350164647a031f34e237f8ff0"
format_stamp: "Formatted at 2026-08-08 05:08:05 on dist-test-slave-bndk"
server_key: "91b06a26148197171de76c5aff736c2f"
server_key_iv: "c1943768d53c3987fa787ecd0967c335"
server_key_version: "encryptionkey@0"
I20260808 05:08:05.038623 16361 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:05.039235 16382 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:05.039381 16361 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:05.039474 16361 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "994b44b350164647a031f34e237f8ff0"
format_stamp: "Formatted at 2026-08-08 05:08:05 on dist-test-slave-bndk"
server_key: "91b06a26148197171de76c5aff736c2f"
server_key_iv: "c1943768d53c3987fa787ecd0967c335"
server_key_version: "encryptionkey@0"
I20260808 05:08:05.039530 16361 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:05.049273 16361 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:05.050848 16361 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:05.050971 16361 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:05.051465 16361 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:05.051503 16361 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:05.051530 16361 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:05.051563 16361 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:08:05 dist-test-slave-bndk krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165685, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:05.058411 16361 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:43587
I20260808 05:08:05.058491 16584 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:43587 every 8 connection(s)
I20260808 05:08:05.058804 16361 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:05.060770 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.051801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:49865 (local address 127.12.251.62:43021)
0808 05:08:05.051865 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.051867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.052038 (+ 171us) server_negotiation.cc:407] Connection header received
0808 05:08:05.052563 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.052565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.052579 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.052628 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:05.053354 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.054122 (+ 768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.055160 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.055366 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.055422 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.058170 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:05.058172 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:05.058172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:05.058181 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:05.059741 (+ 1560us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.060086 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.060087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.060087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.060136 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.060309 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.060310 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.060310 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.060406 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:05.060463 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.060647 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.060706 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:08:05.060936 16395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.051787 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43021 (local address 127.12.251.3:49865)
0808 05:08:05.051925 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.051963 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.052410 (+ 447us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.052738 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.052743 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.053003 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:05.053260 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.053266 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.054225 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.054226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.055073 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.055076 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.055436 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.055438 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.055562 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.056044 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:05.056056 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:05.058081 (+ 2025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:05.059809 (+ 1728us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:05.059814 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:05.059816 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:05.060025 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:05.060179 (+ 154us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:05.060180 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:05.060180 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:05.060269 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:05.060444 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:05.060448 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:05.060552 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.060632 (+ 80us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.060752 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":76,"threads_started":1}
I20260808 05:08:05.061375 16587 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43021
I20260808 05:08:05.061461 16587 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:05.061640 16587 heartbeater.cc:511] Master 127.12.251.62:43021 requested a full tablet report, sending...
I20260808 05:08:05.062000 15824 ts_manager.cc:194] Registered new tserver with Master: 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:05.062428 15824 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:49865
I20260808 05:08:05.067368 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.062469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:50419 (local address 127.12.251.62:43021)
0808 05:08:05.062507 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.062508 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.062601 (+ 93us) server_negotiation.cc:407] Connection header received
0808 05:08:05.062652 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.062652 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.062662 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.062714 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:05.063008 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.063457 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.064102 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.064295 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.064345 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.065122 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:05.065124 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:05.065124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:05.065130 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:05.066347 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.066641 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.066642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.066643 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.066696 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.066854 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.066854 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.066855 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.067007 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:05.067064 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.067197 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.067284 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:08:05.067373 16597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.062373 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43021 (local address 127.12.251.3:50419)
0808 05:08:05.062535 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.062545 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.062599 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.062718 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.062719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.062884 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:05.062944 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.062945 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.063542 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.063543 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.064036 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.064037 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.064350 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.064351 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.064423 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.064788 (+ 365us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:05.064793 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:05.065045 (+ 252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:05.066418 (+ 1373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:05.066419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:05.066419 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:05.066580 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:05.066748 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:05.066748 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:05.066749 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:05.066804 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:05.067062 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:05.067063 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:05.067109 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.067170 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.067267 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":54,"threads_started":1}
I20260808 05:08:05.068435 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 16361
I20260808 05:08:05.068536 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:05.068717 13292 external_mini_cluster.cc:1428] Setting key bb9a400c3eabbd3d37cd4670d5594605
I20260808 05:08:05.069619 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:08:05 dist-test-slave-bndk krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:08:05 dist-test-slave-bndk krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165685, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:05.092581 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.086486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55936 (local address 127.12.251.62:43021)
0808 05:08:05.086555 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.086556 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.086563 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:05.086584 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.086585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.086594 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.086633 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:05.087144 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.087625 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.088305 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.088483 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.088522 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.090605 (+ 2083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:05.090607 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:05.090607 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:05.090614 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:05.091819 (+ 1205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.092071 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.092071 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.092071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.092117 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.092236 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.092236 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.092237 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.092325 (+ 88us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:05.092396 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.092461 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.092516 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:08:05.094023 15824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:05.095539 15824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:05.101897 16615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.097584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:43587 (local address 127.0.0.1:36554)
0808 05:08:05.098037 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.098043 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.098068 (+ 25us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.098498 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.098498 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.098500 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:05.098592 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.098594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.099514 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.099515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.100878 (+ 1363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.100882 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.101608 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.101609 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.101687 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.101700 (+ 13us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.101765 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.101819 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":445,"mutex_wait_us":46,"spinlock_wait_cycles":896,"thread_start_us":58,"threads_started":1}
I20260808 05:08:05.101909 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.097712 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36554 (local address 127.12.251.3:43587)
0808 05:08:05.098346 (+ 634us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.098350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.098360 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:05.098411 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.098413 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.098427 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.098502 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:05.098671 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.099446 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.100975 (+ 1529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.101534 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.101598 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.101659 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.101786 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.101823 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":596,"thread_start_us":72,"threads_started":1}
I20260808 05:08:05.102051 16623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.097774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43635 (local address 127.0.0.1:48124)
0808 05:08:05.098592 (+ 818us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.098601 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.098652 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.098853 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.098854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.098856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:05.098891 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.098892 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.099920 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.099921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.100794 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.100797 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.101803 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.101804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.101880 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.101885 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.101932 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.101969 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":805,"mutex_wait_us":22,"thread_start_us":38,"threads_started":1}
I20260808 05:08:05.102267 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.097893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48124 (local address 127.12.251.1:43635)
0808 05:08:05.098047 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.098052 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.098712 (+ 660us) server_negotiation.cc:407] Connection header received
0808 05:08:05.098756 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.098758 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.098773 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.098842 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:05.098951 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.099851 (+ 900us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.100867 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.101641 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.101711 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.101765 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.102141 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.102178 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":71,"threads_started":1}
I20260808 05:08:05.102635 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.097671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35046 (local address 127.12.251.2:36541)
0808 05:08:05.098085 (+ 414us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.098089 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.098099 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:05.098135 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.098136 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.098149 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.098216 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:05.098417 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.099526 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.100956 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.101652 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.101711 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.101765 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.102500 (+ 735us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.102542 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":378,"thread_start_us":100,"threads_started":1}
I20260808 05:08:05.102564 16465 tablet_service.cc:1467] Processing CreateTablet for tablet d47e8090c7f04012a226f4e03ccab1d0 (DEFAULT_TABLE table=test-table [id=21f84cdff6f249779c49e04b94849535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:05.102829 16616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.097584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:36541 (local address 127.0.0.1:35046)
0808 05:08:05.097873 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.097913 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.097974 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.098222 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.098224 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.098225 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:05.098278 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.098280 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.099599 (+ 1319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.099600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.100880 (+ 1280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.100882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.101802 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.101803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.101887 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.101890 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.101932 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.102767 (+ 835us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":71,"thread_start_us":57,"threads_started":1}
I20260808 05:08:05.102906 16465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d47e8090c7f04012a226f4e03ccab1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.102946 16032 tablet_service.cc:1467] Processing CreateTablet for tablet d47e8090c7f04012a226f4e03ccab1d0 (DEFAULT_TABLE table=test-table [id=21f84cdff6f249779c49e04b94849535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:05.103267 16032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d47e8090c7f04012a226f4e03ccab1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.103524 16241 tablet_service.cc:1467] Processing CreateTablet for tablet d47e8090c7f04012a226f4e03ccab1d0 (DEFAULT_TABLE table=test-table [id=21f84cdff6f249779c49e04b94849535]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:05.103844 16241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d47e8090c7f04012a226f4e03ccab1d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.105643 16626 tablet_bootstrap.cc:492] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Bootstrap starting.
I20260808 05:08:05.106339 16626 tablet_bootstrap.cc:654] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.106612 16626 log.cc:824] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:05.107033 16632 tablet_bootstrap.cc:492] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Bootstrap starting.
I20260808 05:08:05.107424 16626 tablet_bootstrap.cc:492] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: No bootstrap required, opened a new log
I20260808 05:08:05.107497 16626 ts_tablet_manager.cc:1397] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:05.107746 16632 tablet_bootstrap.cc:654] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.108078 16632 log.cc:824] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:05.108490 16638 tablet_bootstrap.cc:492] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Bootstrap starting.
I20260808 05:08:05.108942 16632 tablet_bootstrap.cc:492] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: No bootstrap required, opened a new log
I20260808 05:08:05.109014 16632 ts_tablet_manager.cc:1397] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:05.109534 16626 raft_consensus.cc:348] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.109679 16638 tablet_bootstrap.cc:654] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.109702 16626 raft_consensus.cc:374] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.109738 16626 raft_consensus.cc:729] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 994b44b350164647a031f34e237f8ff0, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.109887 16626 consensus_queue.cc:260] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.109949 16638 log.cc:824] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:05.110149 16626 ts_tablet_manager.cc:1428] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:08:05.110285 16587 heartbeater.cc:503] Master 127.12.251.62:43021 was elected leader, sending a full tablet report...
I20260808 05:08:05.110713 16638 tablet_bootstrap.cc:492] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: No bootstrap required, opened a new log
I20260808 05:08:05.110845 16638 ts_tablet_manager.cc:1397] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:05.110941 16632 raft_consensus.cc:348] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.111092 16632 raft_consensus.cc:374] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.111135 16632 raft_consensus.cc:729] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab3f52c368343cc840f62f3e17f4256, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.111260 16632 consensus_queue.cc:260] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.111544 16632 ts_tablet_manager.cc:1428] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:08:05.111582 16125 heartbeater.cc:503] Master 127.12.251.62:43021 was elected leader, sending a full tablet report...
I20260808 05:08:05.112677 16638 raft_consensus.cc:348] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.112814 16638 raft_consensus.cc:374] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.112859 16638 raft_consensus.cc:729] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.112960 16638 consensus_queue.cc:260] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.113193 16638 ts_tablet_manager.cc:1428] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:08:05.113278 16345 heartbeater.cc:503] Master 127.12.251.62:43021 was elected leader, sending a full tablet report...
I20260808 05:08:05.155416 16647 raft_consensus.cc:482] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:05.155525 16647 raft_consensus.cc:504] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.155900 16647 leader_election.cc:288] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587), 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635)
I20260808 05:08:05.158738 16176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.156042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:43587 (local address 127.12.251.2:46807)
0808 05:08:05.156091 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.156101 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.156142 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.156277 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.156279 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.156280 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:05.156345 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.156346 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.157094 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.157095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.157907 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.157910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.158500 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.158501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.158578 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.158582 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.158634 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.158675 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:08:05.158756 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.156104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:46807 (local address 127.12.251.3:43587)
0808 05:08:05.156157 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.156159 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.156169 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:05.156196 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.156197 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.156206 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.156262 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:05.156413 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.156970 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.157994 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.158421 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.158481 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.158487 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.158646 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.158685 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:05.158847 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.156139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:55185 (local address 127.12.251.1:43635)
0808 05:08:05.156203 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.156205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.156410 (+ 205us) server_negotiation.cc:407] Connection header received
0808 05:08:05.156468 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.156469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.156479 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.156522 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:05.156655 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.157265 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.158160 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.158534 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.158597 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.158604 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.158746 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.158787 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:08:05.158989 16651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.156046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43635 (local address 127.12.251.2:55185)
0808 05:08:05.156348 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.156356 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.156405 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.156530 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.156531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.156532 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:05.156601 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.156603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.157333 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.157334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.158076 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.158078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.158603 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.158604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.158675 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.158679 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.158733 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.158766 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":142,"thread_start_us":104,"threads_started":1}
I20260808 05:08:05.159040 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47e8090c7f04012a226f4e03ccab1d0" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0" is_pre_election: true
I20260808 05:08:05.159171 16496 raft_consensus.cc:2454] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 0.
I20260808 05:08:05.159379 16171 leader_election.cc:302] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 994b44b350164647a031f34e237f8ff0, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:05.159485 16064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47e8090c7f04012a226f4e03ccab1d0" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab3f52c368343cc840f62f3e17f4256" is_pre_election: true
I20260808 05:08:05.159546 16647 raft_consensus.cc:2781] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:05.159619 16647 raft_consensus.cc:482] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:05.159626 16064 raft_consensus.cc:2454] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 0.
I20260808 05:08:05.159652 16647 raft_consensus.cc:3037] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.160354 16647 raft_consensus.cc:504] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.160475 16647 leader_election.cc:288] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 election: Requested vote from peers 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587), 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635)
I20260808 05:08:05.160629 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47e8090c7f04012a226f4e03ccab1d0" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0"
I20260808 05:08:05.160672 16064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d47e8090c7f04012a226f4e03ccab1d0" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab3f52c368343cc840f62f3e17f4256"
I20260808 05:08:05.160701 16496 raft_consensus.cc:3037] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.160737 16064 raft_consensus.cc:3037] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.161468 16496 raft_consensus.cc:2454] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 1.
I20260808 05:08:05.161509 16064 raft_consensus.cc:2454] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 1.
I20260808 05:08:05.161623 16171 leader_election.cc:302] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 994b44b350164647a031f34e237f8ff0, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:05.161720 16647 raft_consensus.cc:2781] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:05.161877 16647 raft_consensus.cc:686] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 1 LEADER]: Becoming Leader. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Running, Role: LEADER
I20260808 05:08:05.161966 16647 consensus_queue.cc:237] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } }
I20260808 05:08:05.162864 15823 catalog_manager.cc:5495] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b reported cstate change: term changed from 0 to 1, leader changed from <none> to afabb5d7d63d412985b17b237e7a586b (127.12.251.2). New cstate: current_term: 1 leader_uuid: "afabb5d7d63d412985b17b237e7a586b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } health_report { overall_health: UNKNOWN } } }
W20260808 05:08:05.163295 16348 tablet.cc:2369] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 08 05:08:05 dist-test-slave-bndk krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165684, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:05.200119 15917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.193900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55942 (local address 127.12.251.62:43021)
0808 05:08:05.193959 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.193961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.194073 (+ 112us) server_negotiation.cc:407] Connection header received
0808 05:08:05.194144 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.194144 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.194155 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.194197 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:05.194647 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.195120 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.195769 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.195947 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.195999 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.198072 (+ 2073us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:05.198074 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:05.198074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:05.198081 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:05.199096 (+ 1015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.199412 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.199413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.199413 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.199473 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:05.199625 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:05.199626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:05.199626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:05.199728 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:05.199782 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.199916 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.200008 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":33}
I20260808 05:08:05.200177 16666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.193823 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43021 (local address 127.0.0.1:55942)
0808 05:08:05.194008 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.194018 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.194080 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.194211 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.194211 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.194526 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:05.194571 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.194574 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.195186 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.195187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.195700 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.195702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.196002 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.196003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.196055 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.196566 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:05.196571 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:05.197992 (+ 1421us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:05.199165 (+ 1173us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:05.199172 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:05.199174 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:05.199350 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:05.199525 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:05.199525 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:05.199526 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:05.199578 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:05.199778 (+ 200us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:05.199786 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:05.199833 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.199889 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.200060 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":63,"thread_start_us":106,"threads_started":1}
I20260808 05:08:05.201959 15823 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:55942:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:08:05.202140 15823 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:05.203521 16032 tablet_service.cc:1467] Processing CreateTablet for tablet fcf23a7de58840a7a28f87bfcacc54db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4a442964005e4fcba5531bae704ec45c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:05.203523 16241 tablet_service.cc:1467] Processing CreateTablet for tablet fcf23a7de58840a7a28f87bfcacc54db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4a442964005e4fcba5531bae704ec45c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:05.203547 16465 tablet_service.cc:1467] Processing CreateTablet for tablet fcf23a7de58840a7a28f87bfcacc54db (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=4a442964005e4fcba5531bae704ec45c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:05.203696 16241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcf23a7de58840a7a28f87bfcacc54db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.203696 16032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcf23a7de58840a7a28f87bfcacc54db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.203702 16465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fcf23a7de58840a7a28f87bfcacc54db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.204783 16626 tablet_bootstrap.cc:492] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: Bootstrap starting.
I20260808 05:08:05.205183 16638 tablet_bootstrap.cc:492] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: Bootstrap starting.
I20260808 05:08:05.205185 16632 tablet_bootstrap.cc:492] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: Bootstrap starting.
I20260808 05:08:05.205325 16626 tablet_bootstrap.cc:654] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.205590 16638 tablet_bootstrap.cc:654] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.205883 16632 tablet_bootstrap.cc:654] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.206061 16626 tablet_bootstrap.cc:492] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: No bootstrap required, opened a new log
I20260808 05:08:05.206113 16626 ts_tablet_manager.cc:1397] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:05.206259 16626 raft_consensus.cc:348] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.206341 16626 raft_consensus.cc:374] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.206364 16626 raft_consensus.cc:729] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 994b44b350164647a031f34e237f8ff0, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.206408 16626 consensus_queue.cc:260] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.206521 16626 ts_tablet_manager.cc:1428] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:05.206548 16632 tablet_bootstrap.cc:492] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: No bootstrap required, opened a new log
I20260808 05:08:05.206602 16632 ts_tablet_manager.cc:1397] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:05.206591 16641 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.206681 16641 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:05.206725 16638 tablet_bootstrap.cc:492] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: No bootstrap required, opened a new log
I20260808 05:08:05.206771 16638 ts_tablet_manager.cc:1397] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:05.206754 16632 raft_consensus.cc:348] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.206835 16632 raft_consensus.cc:374] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.206856 16632 raft_consensus.cc:729] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab3f52c368343cc840f62f3e17f4256, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.206908 16632 consensus_queue.cc:260] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.206907 16638 raft_consensus.cc:348] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.206996 16632 ts_tablet_manager.cc:1428] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:05.207005 16638 raft_consensus.cc:374] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.207037 16638 raft_consensus.cc:729] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.207073 16638 consensus_queue.cc:260] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.207073 16646 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.207142 16646 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:05.207154 16638 ts_tablet_manager.cc:1428] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:05.207288 16647 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.207402 16647 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: This TxnStatusTablet replica's current role is: FOLLOWER
W20260808 05:08:05.263839 16126 tablet.cc:2369] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:08:05.309382 16588 tablet.cc:2369] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:05.360893 16646 raft_consensus.cc:482] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:05.361001 16646 raft_consensus.cc:504] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.361356 16646 leader_election.cc:288] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:05.364382 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.361628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:38035 (local address 127.12.251.2:36541)
0808 05:08:05.361679 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.361682 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.361739 (+ 57us) server_negotiation.cc:407] Connection header received
0808 05:08:05.361830 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.361831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.361840 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.361904 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:05.362042 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.362513 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.363680 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.364058 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.364126 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.364135 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.364271 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.364314 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:08:05.364372 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.361653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:55423 (local address 127.12.251.3:43587)
0808 05:08:05.361707 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.361709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.361764 (+ 55us) server_negotiation.cc:407] Connection header received
0808 05:08:05.361833 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.361834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.361843 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.361888 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:05.362028 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.362732 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.363678 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.364044 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.364099 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.364109 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.364259 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.364299 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:08:05.364399 16672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.361543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:36541 (local address 127.12.251.1:38035)
0808 05:08:05.361675 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.361687 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.361766 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.361916 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.361917 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.361920 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:05.361984 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.361986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.362676 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.362677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.363587 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.363590 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.364137 (+ 547us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.364138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.364206 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.364209 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.364258 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.364299 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260808 05:08:05.364405 16674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.361557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:43587 (local address 127.12.251.1:55423)
0808 05:08:05.361710 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.361720 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.361782 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.361891 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.361891 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.361893 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:05.361969 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.361971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.362818 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.362819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.363590 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.363592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.364122 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.364124 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.364195 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.364198 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.364241 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.364284 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"mutex_wait_us":3,"thread_start_us":89,"threads_started":1}
I20260808 05:08:05.364887 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf23a7de58840a7a28f87bfcacc54db" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0" is_pre_election: true
I20260808 05:08:05.364902 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf23a7de58840a7a28f87bfcacc54db" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afabb5d7d63d412985b17b237e7a586b" is_pre_election: true
I20260808 05:08:05.364979 16496 raft_consensus.cc:2454] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 0.
I20260808 05:08:05.364995 16268 raft_consensus.cc:2454] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 0.
I20260808 05:08:05.365136 15964 leader_election.cc:302] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab3f52c368343cc840f62f3e17f4256, 994b44b350164647a031f34e237f8ff0; no voters:
I20260808 05:08:05.365284 16646 raft_consensus.cc:2781] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:05.365406 16646 raft_consensus.cc:482] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:05.365432 16646 raft_consensus.cc:3037] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.366168 16646 raft_consensus.cc:504] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.366300 16646 leader_election.cc:288] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 election: Requested vote from peers afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:05.366454 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf23a7de58840a7a28f87bfcacc54db" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0"
I20260808 05:08:05.366529 16496 raft_consensus.cc:3037] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.366483 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcf23a7de58840a7a28f87bfcacc54db" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afabb5d7d63d412985b17b237e7a586b"
I20260808 05:08:05.366562 16268 raft_consensus.cc:3037] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.367305 16496 raft_consensus.cc:2454] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 1.
I20260808 05:08:05.367352 16268 raft_consensus.cc:2454] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 1.
I20260808 05:08:05.367520 15964 leader_election.cc:302] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab3f52c368343cc840f62f3e17f4256, 994b44b350164647a031f34e237f8ff0; no voters:
I20260808 05:08:05.367632 16646 raft_consensus.cc:2781] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:05.367753 16646 raft_consensus.cc:686] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [term 1 LEADER]: Becoming Leader. State: Replica: 8ab3f52c368343cc840f62f3e17f4256, State: Running, Role: LEADER
I20260808 05:08:05.367888 16646 consensus_queue.cc:237] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.368255 16675 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: TxnStatusTablet state changed. Reason: New leader 8ab3f52c368343cc840f62f3e17f4256. Latest consensus state: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.368362 16675 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:05.368569 16678 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:08:05.368722 16678 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:08:05.368654 15823 catalog_manager.cc:5495] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1). New cstate: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:05.388831 16666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.386107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43635 (local address 127.0.0.1:48138)
0808 05:08:05.386189 (+ 82us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.386202 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.386253 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.386434 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.386435 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.386436 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:05.386482 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.386484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.387390 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.387391 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.387962 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.387964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.388393 (+ 429us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.388394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.388435 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.388450 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.388705 (+ 255us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.388708 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.388731 (+ 23us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.388768 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:08:05.388846 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.386168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48138 (local address 127.12.251.1:43635)
0808 05:08:05.386235 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.386237 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.386247 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:05.386320 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.386321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.386341 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.386409 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:05.386553 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.387314 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.388032 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.388333 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.388398 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.388526 (+ 128us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.388651 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.388730 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.388745 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.388768 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:08:05.390620 16268 raft_consensus.cc:1261] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Refusing update from remote peer 8ab3f52c368343cc840f62f3e17f4256: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:05.390620 16496 raft_consensus.cc:1261] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Refusing update from remote peer 8ab3f52c368343cc840f62f3e17f4256: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:05.390954 16646 consensus_queue.cc:1035] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:05.391083 16675 consensus_queue.cc:1035] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:05.392288 16647 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: TxnStatusTablet state changed. Reason: New leader 8ab3f52c368343cc840f62f3e17f4256. Latest consensus state: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.392326 16641 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: TxnStatusTablet state changed. Reason: New leader 8ab3f52c368343cc840f62f3e17f4256. Latest consensus state: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.392397 16647 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:05.392411 16641 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:05.393141 16646 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.393237 16646 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:05.393370 16646 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.393453 16646 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P 8ab3f52c368343cc840f62f3e17f4256: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:05.393846 16641 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.393937 16641 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P 994b44b350164647a031f34e237f8ff0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:05.393956 16647 tablet_replica.cc:439] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } } }
I20260808 05:08:05.394033 16647 tablet_replica.cc:442] T fcf23a7de58840a7a28f87bfcacc54db P afabb5d7d63d412985b17b237e7a586b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:05.395051 16689 mvcc.cc:205] Tried to move back new op lower bound from 7316134647357394944 to 7316134647267405824. Current Snapshot: MvccSnapshot[applied={T|T < 7316134647357394944}]
I20260808 05:08:05.395424 16693 mvcc.cc:205] Tried to move back new op lower bound from 7316134647357394944 to 7316134647267405824. Current Snapshot: MvccSnapshot[applied={T|T < 7316134647357394944}]
I20260808 05:08:05.398715 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.396319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35058 (local address 127.12.251.2:36541)
0808 05:08:05.396361 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.396363 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.396372 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:05.396436 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.396437 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.396454 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.396509 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:05.396638 (+ 129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.397182 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.398010 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.398207 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.398260 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.398429 (+ 169us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.398527 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.398593 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.398629 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.398650 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:05.403416 16356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.400949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43635 (local address 127.12.251.2:44209)
0808 05:08:05.401012 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.401023 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.401066 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.401170 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.401170 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.401171 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:05.401254 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.401255 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.402125 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.402126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.402660 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.402662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.403099 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.403099 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.403143 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.403157 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.403307 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.403308 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.403336 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.403368 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:08:05.403429 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.401011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44209 (local address 127.12.251.1:43635)
0808 05:08:05.401049 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.401051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.401059 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:05.401115 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.401116 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.401124 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.401164 (+ 40us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:05.401332 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.402043 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.402732 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.403033 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.403099 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.403226 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.403258 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.403304 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.403341 (+ 37us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.403359 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:08:05.405646 16496 raft_consensus.cc:1261] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Refusing update from remote peer afabb5d7d63d412985b17b237e7a586b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:05.405769 16064 raft_consensus.cc:1261] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Refusing update from remote peer afabb5d7d63d412985b17b237e7a586b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:05.405885 16656 consensus_queue.cc:1035] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [LEADER]: Connected to new peer: Peer: permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:05.406044 16656 consensus_queue.cc:1035] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:05.416137 16619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.411581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:40481 (local address 127.12.251.2:36541)
0808 05:08:05.411619 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.411621 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.413400 (+ 1779us) server_negotiation.cc:407] Connection header received
0808 05:08:05.413469 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.413470 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.413482 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.413546 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:05.413828 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.414268 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.415411 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.415616 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.415677 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.415928 (+ 251us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.415959 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.416000 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.416051 (+ 51us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.416072 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:05.416180 16719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.411543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:36541 (local address 127.12.251.1:40481)
0808 05:08:05.413313 (+ 1770us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.413325 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.413414 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.413699 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.413700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.413701 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:05.413759 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.413760 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.414333 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.414333 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.415302 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.415304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.415721 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.415722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.415831 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.415848 (+ 17us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.416008 (+ 160us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.416010 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.416050 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.416095 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1726,"thread_start_us":77,"threads_started":1}
I20260808 05:08:05.423365 15824 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:05.423471 15824 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:05.424173 15824 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Sending DeleteTablet for 3 replicas of tablet d47e8090c7f04012a226f4e03ccab1d0
I20260808 05:08:05.424494 16241 tablet_service.cc:1514] Processing DeleteTablet for tablet d47e8090c7f04012a226f4e03ccab1d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:05 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:35046
I20260808 05:08:05.424567 16465 tablet_service.cc:1514] Processing DeleteTablet for tablet d47e8090c7f04012a226f4e03ccab1d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:05 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36554
I20260808 05:08:05.424641 16032 tablet_service.cc:1514] Processing DeleteTablet for tablet d47e8090c7f04012a226f4e03ccab1d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:05 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:48124
I20260808 05:08:05.424968 16728 tablet_replica.cc:330] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: stopping tablet replica
I20260808 05:08:05.425004 15824 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55936:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:05.425148 15824 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:05.425098 16728 raft_consensus.cc:2229] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:05.425383 16728 raft_consensus.cc:2258] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:05.425906 16728 ts_tablet_manager.cc:1905] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:05.426218 16241 tablet_service.cc:1467] Processing CreateTablet for tablet a7420878c88d4770bca1e4d1ac05905f (DEFAULT_TABLE table=test-table [id=62ed377d4ee347c4b50db3dcb62489ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:05.426365 16241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7420878c88d4770bca1e4d1ac05905f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.426494 16723 tablet_replica.cc:330] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: stopping tablet replica
I20260808 05:08:05.426822 16723 raft_consensus.cc:2229] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:05.427721 16638 tablet_bootstrap.cc:492] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: Bootstrap starting.
I20260808 05:08:05.427884 16723 raft_consensus.cc:2258] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:05.428182 16638 tablet_bootstrap.cc:654] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.428435 16723 ts_tablet_manager.cc:1905] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:05.428576 16032 tablet_service.cc:1467] Processing CreateTablet for tablet a7420878c88d4770bca1e4d1ac05905f (DEFAULT_TABLE table=test-table [id=62ed377d4ee347c4b50db3dcb62489ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:05.428685 16032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7420878c88d4770bca1e4d1ac05905f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.429651 16465 tablet_service.cc:1467] Processing CreateTablet for tablet a7420878c88d4770bca1e4d1ac05905f (DEFAULT_TABLE table=test-table [id=62ed377d4ee347c4b50db3dcb62489ba]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:05.429777 16465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a7420878c88d4770bca1e4d1ac05905f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:05.430152 16728 ts_tablet_manager.cc:1918] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:05.430261 16728 log.cc:1196] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/d47e8090c7f04012a226f4e03ccab1d0
I20260808 05:08:05.430563 16728 ts_tablet_manager.cc:1939] T d47e8090c7f04012a226f4e03ccab1d0 P 8ab3f52c368343cc840f62f3e17f4256: Deleting consensus metadata
I20260808 05:08:05.430712 16726 tablet_replica.cc:330] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: stopping tablet replica
I20260808 05:08:05.430858 16726 raft_consensus.cc:2229] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:05.430968 16726 raft_consensus.cc:2258] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:05.431524 16723 ts_tablet_manager.cc:1918] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:05.431100 16626 tablet_bootstrap.cc:492] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: Bootstrap starting.
I20260808 05:08:05.431978 16626 tablet_bootstrap.cc:654] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.432603 16626 tablet_bootstrap.cc:492] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: No bootstrap required, opened a new log
I20260808 05:08:05.432652 16626 ts_tablet_manager.cc:1397] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:08:05.432797 16626 raft_consensus.cc:348] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.432859 16626 raft_consensus.cc:374] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.432878 16626 raft_consensus.cc:729] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 994b44b350164647a031f34e237f8ff0, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.432874 16632 tablet_bootstrap.cc:492] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: Bootstrap starting.
I20260808 05:08:05.432940 16626 consensus_queue.cc:260] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.433019 16626 ts_tablet_manager.cc:1428] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:05.433283 16632 tablet_bootstrap.cc:654] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:05.434336 15806 catalog_manager.cc:4841] TS 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635): tablet d47e8090c7f04012a226f4e03ccab1d0 (table test-table [id=21f84cdff6f249779c49e04b94849535]) successfully deleted
I20260808 05:08:05.434599 16726 ts_tablet_manager.cc:1905] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:05.436045 16726 ts_tablet_manager.cc:1918] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:05.436116 16726 log.cc:1196] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/d47e8090c7f04012a226f4e03ccab1d0
I20260808 05:08:05.436333 16726 ts_tablet_manager.cc:1939] T d47e8090c7f04012a226f4e03ccab1d0 P 994b44b350164647a031f34e237f8ff0: Deleting consensus metadata
I20260808 05:08:05.431977 16638 tablet_bootstrap.cc:492] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: No bootstrap required, opened a new log
I20260808 05:08:05.436502 16723 log.cc:1196] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/d47e8090c7f04012a226f4e03ccab1d0
I20260808 05:08:05.436528 16638 ts_tablet_manager.cc:1397] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260808 05:08:05.436681 16638 raft_consensus.cc:348] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.436743 16638 raft_consensus.cc:374] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.436772 16638 raft_consensus.cc:729] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.436812 16638 consensus_queue.cc:260] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.436890 16638 ts_tablet_manager.cc:1428] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:05.437053 15807 catalog_manager.cc:4841] TS 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587): tablet d47e8090c7f04012a226f4e03ccab1d0 (table test-table [id=21f84cdff6f249779c49e04b94849535]) successfully deleted
I20260808 05:08:05.436746 16723 ts_tablet_manager.cc:1939] T d47e8090c7f04012a226f4e03ccab1d0 P afabb5d7d63d412985b17b237e7a586b: Deleting consensus metadata
I20260808 05:08:05.437731 15806 catalog_manager.cc:4841] TS afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541): tablet d47e8090c7f04012a226f4e03ccab1d0 (table test-table [id=21f84cdff6f249779c49e04b94849535]) successfully deleted
I20260808 05:08:05.437918 16632 tablet_bootstrap.cc:492] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: No bootstrap required, opened a new log
I20260808 05:08:05.437980 16632 ts_tablet_manager.cc:1397] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 05:08:05.438090 16632 raft_consensus.cc:348] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.438163 16632 raft_consensus.cc:374] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:05.438184 16632 raft_consensus.cc:729] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab3f52c368343cc840f62f3e17f4256, State: Initialized, Role: FOLLOWER
I20260808 05:08:05.438226 16632 consensus_queue.cc:260] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.438316 16632 ts_tablet_manager.cc:1428] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:05.796504 16697 raft_consensus.cc:482] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:05.796633 16697 raft_consensus.cc:504] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.796820 16697 leader_election.cc:288] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:05.797049 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7420878c88d4770bca1e4d1ac05905f" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afabb5d7d63d412985b17b237e7a586b" is_pre_election: true
I20260808 05:08:05.797050 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7420878c88d4770bca1e4d1ac05905f" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0" is_pre_election: true
I20260808 05:08:05.797149 16496 raft_consensus.cc:2454] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 0.
I20260808 05:08:05.797151 16268 raft_consensus.cc:2454] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 0.
I20260808 05:08:05.797336 15963 leader_election.cc:302] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab3f52c368343cc840f62f3e17f4256, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:05.797452 16697 raft_consensus.cc:2781] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:05.797497 16697 raft_consensus.cc:482] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:05.797511 16697 raft_consensus.cc:3037] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.798260 16697 raft_consensus.cc:504] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.798386 16697 leader_election.cc:288] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 election: Requested vote from peers afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:05.798547 16268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7420878c88d4770bca1e4d1ac05905f" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "afabb5d7d63d412985b17b237e7a586b"
I20260808 05:08:05.798612 16268 raft_consensus.cc:3037] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.798553 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a7420878c88d4770bca1e4d1ac05905f" candidate_uuid: "8ab3f52c368343cc840f62f3e17f4256" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0"
I20260808 05:08:05.798645 16496 raft_consensus.cc:3037] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:05.799197 16268 raft_consensus.cc:2454] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 1.
I20260808 05:08:05.799295 16496 raft_consensus.cc:2454] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8ab3f52c368343cc840f62f3e17f4256 in term 1.
I20260808 05:08:05.799381 15963 leader_election.cc:302] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab3f52c368343cc840f62f3e17f4256, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:05.799474 16697 raft_consensus.cc:2781] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:05.799541 16697 raft_consensus.cc:686] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 1 LEADER]: Becoming Leader. State: Replica: 8ab3f52c368343cc840f62f3e17f4256, State: Running, Role: LEADER
I20260808 05:08:05.799592 16697 consensus_queue.cc:237] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:05.800168 15823 catalog_manager.cc:5495] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1). New cstate: current_term: 1 leader_uuid: "8ab3f52c368343cc840f62f3e17f4256" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:05.876102 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.874309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48150 (local address 127.12.251.1:43635)
0808 05:08:05.874350 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.874352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.874377 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:08:05.874397 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.874397 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.874406 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.874440 (+ 34us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:05.874528 (+ 88us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.874986 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.875654 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.875821 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.875864 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.875950 (+ 86us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.875973 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.876003 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.876033 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.876046 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:08:05.879822 16719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.878025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43635 (local address 127.12.251.1:59649)
0808 05:08:05.878059 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:05.878070 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:05.878112 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:05.878211 (+ 99us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:05.878212 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:05.878213 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:05.878245 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.878247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.878771 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.878771 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.879271 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:05.879272 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.879573 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.879574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:05.879609 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.879613 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.879707 (+ 94us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.879708 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:05.879735 (+ 27us) client_negotiation.cc:240] Negotiation successful
0808 05:08:05.879764 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 05:08:05.879829 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:05.878093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:59649 (local address 127.12.251.1:43635)
0808 05:08:05.878137 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:05.878138 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:05.878145 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:05.878162 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:05.878163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:05.878169 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:05.878210 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:05.878279 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.878720 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.879346 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:05.879518 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:05.879570 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:05.879655 (+ 85us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:05.879678 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:05.879708 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:05.879738 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 05:08:05.879749 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:08:05.881441 16268 raft_consensus.cc:1261] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Refusing update from remote peer 8ab3f52c368343cc840f62f3e17f4256: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:05.881441 16496 raft_consensus.cc:1261] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Refusing update from remote peer 8ab3f52c368343cc840f62f3e17f4256: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:05.881650 16675 consensus_queue.cc:1035] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:05.881745 16646 consensus_queue.cc:1035] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [LEADER]: Connected to new peer: Peer: permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:05.883016 16683 mvcc.cc:205] Tried to move back new op lower bound from 7316134649369235456 to 7316134649035567104. Current Snapshot: MvccSnapshot[applied={T|T < 7316134649369235456}]
W20260808 05:08:05.885922 16683 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 05:08:07.403290 15822 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:07.403401 15822 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55936:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:07.404204 15822 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Sending DeleteTablet for 3 replicas of tablet a7420878c88d4770bca1e4d1ac05905f
I20260808 05:08:07.404458 16032 tablet_service.cc:1514] Processing DeleteTablet for tablet a7420878c88d4770bca1e4d1ac05905f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:07 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:48124
I20260808 05:08:07.404497 16241 tablet_service.cc:1514] Processing DeleteTablet for tablet a7420878c88d4770bca1e4d1ac05905f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:07 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:35046
I20260808 05:08:07.404495 16465 tablet_service.cc:1514] Processing DeleteTablet for tablet a7420878c88d4770bca1e4d1ac05905f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:07 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36554
I20260808 05:08:07.404711 16774 tablet_replica.cc:330] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: stopping tablet replica
I20260808 05:08:07.404768 16774 raft_consensus.cc:2229] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:07.404798 16774 raft_consensus.cc:2258] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:07.404892 16776 tablet_replica.cc:330] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: stopping tablet replica
I20260808 05:08:07.404934 16776 raft_consensus.cc:2229] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:07.404968 16776 raft_consensus.cc:2258] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:07.405049 16774 ts_tablet_manager.cc:1905] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:07.405187 16776 ts_tablet_manager.cc:1905] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:07.406663 16774 ts_tablet_manager.cc:1918] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:08:07.406713 16774 log.cc:1196] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/a7420878c88d4770bca1e4d1ac05905f
I20260808 05:08:07.406756 16776 ts_tablet_manager.cc:1918] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:08:07.406809 16776 log.cc:1196] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/a7420878c88d4770bca1e4d1ac05905f
I20260808 05:08:07.406883 16774 ts_tablet_manager.cc:1939] T a7420878c88d4770bca1e4d1ac05905f P afabb5d7d63d412985b17b237e7a586b: Deleting consensus metadata
I20260808 05:08:07.407039 16776 ts_tablet_manager.cc:1939] T a7420878c88d4770bca1e4d1ac05905f P 994b44b350164647a031f34e237f8ff0: Deleting consensus metadata
I20260808 05:08:07.407135 15806 catalog_manager.cc:4841] TS afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541): tablet a7420878c88d4770bca1e4d1ac05905f (table test-table [id=62ed377d4ee347c4b50db3dcb62489ba]) successfully deleted
I20260808 05:08:07.407490 15807 catalog_manager.cc:4841] TS 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587): tablet a7420878c88d4770bca1e4d1ac05905f (table test-table [id=62ed377d4ee347c4b50db3dcb62489ba]) successfully deleted
I20260808 05:08:07.409076 16769 tablet_replica.cc:330] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: stopping tablet replica
I20260808 05:08:07.409133 16769 raft_consensus.cc:2229] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:07.409231 16769 raft_consensus.cc:2258] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:07.409436 16769 ts_tablet_manager.cc:1905] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:07.410737 16769 ts_tablet_manager.cc:1918] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:08:07.410789 16769 log.cc:1196] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/a7420878c88d4770bca1e4d1ac05905f
I20260808 05:08:07.411011 16769 ts_tablet_manager.cc:1939] T a7420878c88d4770bca1e4d1ac05905f P 8ab3f52c368343cc840f62f3e17f4256: Deleting consensus metadata
I20260808 05:08:07.411274 15806 catalog_manager.cc:4841] TS 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635): tablet a7420878c88d4770bca1e4d1ac05905f (table test-table [id=62ed377d4ee347c4b50db3dcb62489ba]) successfully deleted
Aug 08 05:08:07 dist-test-slave-bndk krb5kdc[15753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165687, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:08:07 dist-test-slave-bndk krb5kdc[15753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165687, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:07.432817 16787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:07.422662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37918 (local address 127.12.251.62:43021)
0808 05:08:07.422801 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:07.422803 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:07.422812 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:07.422873 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:07.422874 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:07.422884 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:07.422939 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:07.423432 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:07.423998 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:07.424711 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:07.424937 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:07.424997 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:07.430707 (+ 5710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:07.430708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:07.430709 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:07.430715 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:07.431902 (+ 1187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:07.432190 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:07.432190 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:07.432191 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:07.432251 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:07.432441 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:07.432441 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:07.432442 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:07.432538 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:07.432609 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:07.432682 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 05:08:07.432747 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":92,"threads_started":1}
I20260808 05:08:07.434123 15822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:07.434275 15822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:07.435483 16032 tablet_service.cc:1467] Processing CreateTablet for tablet 0584febd590448589d5257ff82fad541 (DEFAULT_TABLE table=test-table [id=3d240f222ecd428aa0289ebe3717537f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:07.435514 16241 tablet_service.cc:1467] Processing CreateTablet for tablet 0584febd590448589d5257ff82fad541 (DEFAULT_TABLE table=test-table [id=3d240f222ecd428aa0289ebe3717537f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:07.435514 16465 tablet_service.cc:1467] Processing CreateTablet for tablet 0584febd590448589d5257ff82fad541 (DEFAULT_TABLE table=test-table [id=3d240f222ecd428aa0289ebe3717537f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:07.435621 16032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0584febd590448589d5257ff82fad541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:07.435621 16241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0584febd590448589d5257ff82fad541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:07.435634 16465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0584febd590448589d5257ff82fad541. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:07.436615 16789 tablet_bootstrap.cc:492] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: Bootstrap starting.
I20260808 05:08:07.437009 16790 tablet_bootstrap.cc:492] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: Bootstrap starting.
I20260808 05:08:07.437101 16791 tablet_bootstrap.cc:492] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: Bootstrap starting.
I20260808 05:08:07.437155 16789 tablet_bootstrap.cc:654] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:07.437361 16790 tablet_bootstrap.cc:654] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:07.437469 16791 tablet_bootstrap.cc:654] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:07.437898 16789 tablet_bootstrap.cc:492] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: No bootstrap required, opened a new log
I20260808 05:08:07.437963 16789 ts_tablet_manager.cc:1397] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:07.438019 16791 tablet_bootstrap.cc:492] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: No bootstrap required, opened a new log
I20260808 05:08:07.438066 16791 ts_tablet_manager.cc:1397] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:07.438102 16789 raft_consensus.cc:348] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.438177 16789 raft_consensus.cc:374] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:07.438203 16789 raft_consensus.cc:729] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 994b44b350164647a031f34e237f8ff0, State: Initialized, Role: FOLLOWER
I20260808 05:08:07.438174 16791 raft_consensus.cc:348] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.438232 16791 raft_consensus.cc:374] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:07.438259 16791 raft_consensus.cc:729] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Initialized, Role: FOLLOWER
I20260808 05:08:07.438249 16789 consensus_queue.cc:260] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.438326 16791 consensus_queue.cc:260] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.438433 16789 ts_tablet_manager.cc:1428] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:07.438493 16791 ts_tablet_manager.cc:1428] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:07.438656 16790 tablet_bootstrap.cc:492] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: No bootstrap required, opened a new log
I20260808 05:08:07.438696 16790 ts_tablet_manager.cc:1397] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:07.438800 16790 raft_consensus.cc:348] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.438870 16790 raft_consensus.cc:374] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:07.438889 16790 raft_consensus.cc:729] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab3f52c368343cc840f62f3e17f4256, State: Initialized, Role: FOLLOWER
I20260808 05:08:07.438935 16790 consensus_queue.cc:260] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.439036 16790 ts_tablet_manager.cc:1428] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:07.521391 16798 raft_consensus.cc:482] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:07.521510 16798 raft_consensus.cc:504] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.521685 16798 leader_election.cc:288] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:07.521890 16064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0584febd590448589d5257ff82fad541" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab3f52c368343cc840f62f3e17f4256" is_pre_election: true
I20260808 05:08:07.521904 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0584febd590448589d5257ff82fad541" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0" is_pre_election: true
I20260808 05:08:07.521984 16064 raft_consensus.cc:2454] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 0.
I20260808 05:08:07.522009 16496 raft_consensus.cc:2454] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 0.
I20260808 05:08:07.522161 16170 leader_election.cc:302] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8ab3f52c368343cc840f62f3e17f4256, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:07.522265 16798 raft_consensus.cc:2781] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:07.522312 16798 raft_consensus.cc:482] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:07.522336 16798 raft_consensus.cc:3037] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:07.523078 16798 raft_consensus.cc:504] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.523195 16798 leader_election.cc:288] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 election: Requested vote from peers 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:07.523324 16064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0584febd590448589d5257ff82fad541" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab3f52c368343cc840f62f3e17f4256"
I20260808 05:08:07.523348 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0584febd590448589d5257ff82fad541" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0"
I20260808 05:08:07.523406 16064 raft_consensus.cc:3037] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:07.523408 16496 raft_consensus.cc:3037] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:07.524127 16064 raft_consensus.cc:2454] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 1.
I20260808 05:08:07.524127 16496 raft_consensus.cc:2454] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 1.
I20260808 05:08:07.524287 16171 leader_election.cc:302] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 994b44b350164647a031f34e237f8ff0, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:07.524392 16798 raft_consensus.cc:2781] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:07.524561 16798 raft_consensus.cc:686] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 1 LEADER]: Becoming Leader. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Running, Role: LEADER
I20260808 05:08:07.524614 16798 consensus_queue.cc:237] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.525246 15822 catalog_manager.cc:5495] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b reported cstate change: term changed from 0 to 1, leader changed from <none> to afabb5d7d63d412985b17b237e7a586b (127.12.251.2). New cstate: current_term: 1 leader_uuid: "afabb5d7d63d412985b17b237e7a586b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:07.532039 16805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:07.530098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36752 (local address 127.12.251.2:36541)
0808 05:08:07.530228 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:07.530230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:07.530238 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:07.530259 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:07.530259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:07.530269 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:07.530326 (+ 57us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:07.530417 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:07.530878 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:07.531568 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:07.531752 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:07.531800 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:07.531883 (+ 83us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:07.531906 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:07.531936 (+ 30us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:07.531968 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 05:08:07.531985 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":77,"threads_started":1}
I20260808 05:08:07.533910 16496 raft_consensus.cc:1261] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Refusing update from remote peer afabb5d7d63d412985b17b237e7a586b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:07.533983 16064 raft_consensus.cc:1261] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Refusing update from remote peer afabb5d7d63d412985b17b237e7a586b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:07.534109 16799 consensus_queue.cc:1035] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [LEADER]: Connected to new peer: Peer: permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:07.534186 16798 consensus_queue.cc:1035] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:07.543233 15822 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:07.543316 15822 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:07.543898 15822 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Sending DeleteTablet for 3 replicas of tablet 0584febd590448589d5257ff82fad541
I20260808 05:08:07.544147 16032 tablet_service.cc:1514] Processing DeleteTablet for tablet 0584febd590448589d5257ff82fad541 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:07 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:48124
I20260808 05:08:07.544147 16465 tablet_service.cc:1514] Processing DeleteTablet for tablet 0584febd590448589d5257ff82fad541 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:07 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36554
I20260808 05:08:07.544188 16241 tablet_service.cc:1514] Processing DeleteTablet for tablet 0584febd590448589d5257ff82fad541 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:07 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:35046
I20260808 05:08:07.544241 16769 tablet_replica.cc:330] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: stopping tablet replica
I20260808 05:08:07.544243 16776 tablet_replica.cc:330] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: stopping tablet replica
I20260808 05:08:07.544272 16774 tablet_replica.cc:330] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: stopping tablet replica
I20260808 05:08:07.544286 16776 raft_consensus.cc:2229] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:07.544283 16769 raft_consensus.cc:2229] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:07.544315 16776 raft_consensus.cc:2258] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:07.544315 16769 raft_consensus.cc:2258] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:07.544378 16774 raft_consensus.cc:2229] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:07.544440 16774 raft_consensus.cc:2258] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:07.544633 16769 ts_tablet_manager.cc:1905] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:07.544759 16774 ts_tablet_manager.cc:1905] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:07.544785 16776 ts_tablet_manager.cc:1905] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:07.546221 15822 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:07.546360 15822 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:07.546510 16776 ts_tablet_manager.cc:1918] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:07.546532 16769 ts_tablet_manager.cc:1918] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:07.546545 16774 ts_tablet_manager.cc:1918] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:07.546571 16776 log.cc:1196] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/0584febd590448589d5257ff82fad541
I20260808 05:08:07.546590 16769 log.cc:1196] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/0584febd590448589d5257ff82fad541
I20260808 05:08:07.546594 16774 log.cc:1196] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/0584febd590448589d5257ff82fad541
I20260808 05:08:07.546783 16769 ts_tablet_manager.cc:1939] T 0584febd590448589d5257ff82fad541 P 8ab3f52c368343cc840f62f3e17f4256: Deleting consensus metadata
I20260808 05:08:07.546783 16776 ts_tablet_manager.cc:1939] T 0584febd590448589d5257ff82fad541 P 994b44b350164647a031f34e237f8ff0: Deleting consensus metadata
I20260808 05:08:07.546797 16774 ts_tablet_manager.cc:1939] T 0584febd590448589d5257ff82fad541 P afabb5d7d63d412985b17b237e7a586b: Deleting consensus metadata
I20260808 05:08:07.547088 15807 catalog_manager.cc:4841] TS 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587): tablet 0584febd590448589d5257ff82fad541 (table test-table [id=3d240f222ecd428aa0289ebe3717537f]) successfully deleted
I20260808 05:08:07.547102 15806 catalog_manager.cc:4841] TS 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635): tablet 0584febd590448589d5257ff82fad541 (table test-table [id=3d240f222ecd428aa0289ebe3717537f]) successfully deleted
I20260808 05:08:07.547214 15806 catalog_manager.cc:4841] TS afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541): tablet 0584febd590448589d5257ff82fad541 (table test-table [id=3d240f222ecd428aa0289ebe3717537f]) successfully deleted
I20260808 05:08:07.547931 16032 tablet_service.cc:1467] Processing CreateTablet for tablet 3bbc9dcafd5d440583be099b1674e8cb (DEFAULT_TABLE table=test-table [id=769a3ad2a4884991996894cdf55aaeb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:07.547941 16241 tablet_service.cc:1467] Processing CreateTablet for tablet 3bbc9dcafd5d440583be099b1674e8cb (DEFAULT_TABLE table=test-table [id=769a3ad2a4884991996894cdf55aaeb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:07.547960 16465 tablet_service.cc:1467] Processing CreateTablet for tablet 3bbc9dcafd5d440583be099b1674e8cb (DEFAULT_TABLE table=test-table [id=769a3ad2a4884991996894cdf55aaeb9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:07.548043 16032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bbc9dcafd5d440583be099b1674e8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:07.548043 16241 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bbc9dcafd5d440583be099b1674e8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:07.548064 16465 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3bbc9dcafd5d440583be099b1674e8cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:07.548923 16789 tablet_bootstrap.cc:492] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: Bootstrap starting.
I20260808 05:08:07.549187 16790 tablet_bootstrap.cc:492] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256: Bootstrap starting.
I20260808 05:08:07.549306 16789 tablet_bootstrap.cc:654] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:07.549487 16790 tablet_bootstrap.cc:654] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:07.549777 16791 tablet_bootstrap.cc:492] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: Bootstrap starting.
I20260808 05:08:07.549971 16790 tablet_bootstrap.cc:492] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256: No bootstrap required, opened a new log
I20260808 05:08:07.550014 16790 ts_tablet_manager.cc:1397] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:08:07.550045 16791 tablet_bootstrap.cc:654] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:07.550119 16790 raft_consensus.cc:348] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.550177 16790 raft_consensus.cc:374] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:07.550195 16790 raft_consensus.cc:729] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ab3f52c368343cc840f62f3e17f4256, State: Initialized, Role: FOLLOWER
I20260808 05:08:07.550242 16790 consensus_queue.cc:260] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.550334 16790 ts_tablet_manager.cc:1428] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:07.550623 16789 tablet_bootstrap.cc:492] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: No bootstrap required, opened a new log
I20260808 05:08:07.550676 16789 ts_tablet_manager.cc:1397] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:08:07.550899 16789 raft_consensus.cc:348] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.550981 16789 raft_consensus.cc:374] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:07.551002 16789 raft_consensus.cc:729] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 994b44b350164647a031f34e237f8ff0, State: Initialized, Role: FOLLOWER
I20260808 05:08:07.551048 16789 consensus_queue.cc:260] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.551141 16789 ts_tablet_manager.cc:1428] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:07.551568 16791 tablet_bootstrap.cc:492] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: No bootstrap required, opened a new log
I20260808 05:08:07.551622 16791 ts_tablet_manager.cc:1397] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260808 05:08:07.551723 16791 raft_consensus.cc:348] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.551776 16791 raft_consensus.cc:374] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:07.551795 16791 raft_consensus.cc:729] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Initialized, Role: FOLLOWER
I20260808 05:08:07.551842 16791 consensus_queue.cc:260] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.551934 16791 ts_tablet_manager.cc:1428] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:07.677343 16799 raft_consensus.cc:482] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:07.677452 16799 raft_consensus.cc:504] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.677600 16799 leader_election.cc:288] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:07.677845 16064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bbc9dcafd5d440583be099b1674e8cb" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab3f52c368343cc840f62f3e17f4256" is_pre_election: true
I20260808 05:08:07.677845 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bbc9dcafd5d440583be099b1674e8cb" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0" is_pre_election: true
I20260808 05:08:07.677958 16496 raft_consensus.cc:2454] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 0.
I20260808 05:08:07.677973 16064 raft_consensus.cc:2454] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 0.
I20260808 05:08:07.678123 16171 leader_election.cc:302] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 994b44b350164647a031f34e237f8ff0, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:07.678247 16799 raft_consensus.cc:2781] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:07.678288 16799 raft_consensus.cc:482] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:07.678301 16799 raft_consensus.cc:3037] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:07.679039 16799 raft_consensus.cc:504] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.679170 16799 leader_election.cc:288] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 election: Requested vote from peers 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635), 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587)
I20260808 05:08:07.679347 16064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bbc9dcafd5d440583be099b1674e8cb" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8ab3f52c368343cc840f62f3e17f4256"
I20260808 05:08:07.679338 16496 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3bbc9dcafd5d440583be099b1674e8cb" candidate_uuid: "afabb5d7d63d412985b17b237e7a586b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "994b44b350164647a031f34e237f8ff0"
I20260808 05:08:07.679426 16064 raft_consensus.cc:3037] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:07.679426 16496 raft_consensus.cc:3037] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:07.680169 16496 raft_consensus.cc:2454] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 1.
I20260808 05:08:07.680169 16064 raft_consensus.cc:2454] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate afabb5d7d63d412985b17b237e7a586b in term 1.
I20260808 05:08:07.680367 16171 leader_election.cc:302] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 994b44b350164647a031f34e237f8ff0, afabb5d7d63d412985b17b237e7a586b; no voters:
I20260808 05:08:07.680464 16799 raft_consensus.cc:2781] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:07.680521 16799 raft_consensus.cc:686] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 1 LEADER]: Becoming Leader. State: Replica: afabb5d7d63d412985b17b237e7a586b, State: Running, Role: LEADER
I20260808 05:08:07.680572 16799 consensus_queue.cc:237] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } }
I20260808 05:08:07.681159 15822 catalog_manager.cc:5495] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b reported cstate change: term changed from 0 to 1, leader changed from <none> to afabb5d7d63d412985b17b237e7a586b (127.12.251.2). New cstate: current_term: 1 leader_uuid: "afabb5d7d63d412985b17b237e7a586b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "afabb5d7d63d412985b17b237e7a586b" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 36541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:07.698170 16496 raft_consensus.cc:1261] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Refusing update from remote peer afabb5d7d63d412985b17b237e7a586b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:07.698187 16064 raft_consensus.cc:1261] T 3bbc9dcafd5d440583be099b1674e8cb P 8ab3f52c368343cc840f62f3e17f4256 [term 1 FOLLOWER]: Refusing update from remote peer afabb5d7d63d412985b17b237e7a586b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:07.698396 16811 consensus_queue.cc:1035] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [LEADER]: Connected to new peer: Peer: permanent_uuid: "994b44b350164647a031f34e237f8ff0" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:07.698500 16799 consensus_queue.cc:1035] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [LEADER]: Connected to new peer: Peer: permanent_uuid: "8ab3f52c368343cc840f62f3e17f4256" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43635 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:08:07.702564 16749 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260808 05:08:09.219151 15823 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:09.219254 15823 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:37918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:09.220129 15823 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 694ebc7b744a4244b1332d0381b1fd28: Sending DeleteTablet for 3 replicas of tablet 3bbc9dcafd5d440583be099b1674e8cb
I20260808 05:08:09.220373 16465 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bbc9dcafd5d440583be099b1674e8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:09 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36554
I20260808 05:08:09.220387 16241 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bbc9dcafd5d440583be099b1674e8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:09 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:35046
I20260808 05:08:09.220410 16030 tablet_service.cc:1514] Processing DeleteTablet for tablet 3bbc9dcafd5d440583be099b1674e8cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:09 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:48124
I20260808 05:08:09.220599 16847 tablet_replica.cc:330] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: stopping tablet replica
I20260808 05:08:09.220649 16847 raft_consensus.cc:2229] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:09.220700 16847 raft_consensus.cc:2258] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:09.220695 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 15929
I20260808 05:08:09.241638 16847 ts_tablet_manager.cc:1905] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:09.243607 16847 ts_tablet_manager.cc:1918] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:08:09.243672 16847 log.cc:1196] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/3bbc9dcafd5d440583be099b1674e8cb
I20260808 05:08:09.243876 16847 ts_tablet_manager.cc:1939] T 3bbc9dcafd5d440583be099b1674e8cb P afabb5d7d63d412985b17b237e7a586b: Deleting consensus metadata
I20260808 05:08:09.244092 16849 tablet_replica.cc:330] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: stopping tablet replica
I20260808 05:08:09.244175 16849 raft_consensus.cc:2229] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:09.244231 16849 raft_consensus.cc:2258] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:09.244244 15806 catalog_manager.cc:4841] TS afabb5d7d63d412985b17b237e7a586b (127.12.251.2:36541): tablet 3bbc9dcafd5d440583be099b1674e8cb (table test-table [id=769a3ad2a4884991996894cdf55aaeb9]) successfully deleted
I20260808 05:08:09.244475 16849 ts_tablet_manager.cc:1905] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:09.245647 16849 ts_tablet_manager.cc:1918] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260808 05:08:09.245699 16849 log.cc:1196] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/3bbc9dcafd5d440583be099b1674e8cb
I20260808 05:08:09.245874 16849 ts_tablet_manager.cc:1939] T 3bbc9dcafd5d440583be099b1674e8cb P 994b44b350164647a031f34e237f8ff0: Deleting consensus metadata
I20260808 05:08:09.246197 15807 catalog_manager.cc:4841] TS 994b44b350164647a031f34e237f8ff0 (127.12.251.3:43587): tablet 3bbc9dcafd5d440583be099b1674e8cb (table test-table [id=769a3ad2a4884991996894cdf55aaeb9]) successfully deleted
W20260808 05:08:09.249677 15806 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:43635 (error 108)
I20260808 05:08:09.249928 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 16143
I20260808 05:08:09.256361 16851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:09.250041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43635 (local address 127.0.0.1:41120)
0808 05:08:09.256244 (+ 6203us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:09.256312 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:43635: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":6168,"thread_start_us":58,"threads_started":1}
W20260808 05:08:09.256520 15806 catalog_manager.cc:4584] TS 8ab3f52c368343cc840f62f3e17f4256 (127.12.251.1:43635): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3bbc9dcafd5d440583be099b1674e8cb: Network error: Client connection negotiation failed: client connection to 127.12.251.1:43635: connect: Connection refused (error 111)
I20260808 05:08:09.263562 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 16361
I20260808 05:08:09.284933 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 15779
2026-08-08T05:08:09Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6083 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:09 dist-test-slave-bndk krb5kdc[16855](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:09 dist-test-slave-bndk krb5kdc[16855](info): set up 2 sockets
Aug 08 05:08:09 dist-test-slave-bndk krb5kdc[16855](info): commencing operation
krb5kdc: starting...
W20260808 05:08:10.405050 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:10 dist-test-slave-bndk krb5kdc[16855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:10.518195 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:40661
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:40661
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:10.599054 16880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:10.599244 16880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:10.599264 16880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:10.600322 16880 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:10.600353 16880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:10.600366 16880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:10.600378 16880 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:10.600400 16880 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:10.601866 16880 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:40661
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:40661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:10.602052 16880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:10.602224 16880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:10.606706 16890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:10.606722 16889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:10.606808 16880 server_base.cc:1034] running on GCE node
W20260808 05:08:10.606776 16897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:10.607228 16880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:10.607467 16880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:10.608618 16880 hybrid_clock.cc:648] HybridClock initialized: now 1786165690608603 us; error 30 us; skew 500 ppm
Aug 08 05:08:10 dist-test-slave-bndk krb5kdc[16855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165690, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:10.610975 16880 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:10.611362 16880 webserver.cc:460] Webserver started at http://127.12.251.62:43101/ using document root <none> and password file <none>
I20260808 05:08:10.611595 16880 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:10.611641 16880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:10.611733 16880 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:10.612673 16880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "7a2a954ca3d44e52b20208acbb0a05e0"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "af8f0a39c1d36a3b12215ade50ed31f1"
server_key_iv: "b1ac976cd7ce87d5c8b3e1f7db0d4e3f"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.612958 16880 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "7a2a954ca3d44e52b20208acbb0a05e0"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "af8f0a39c1d36a3b12215ade50ed31f1"
server_key_iv: "b1ac976cd7ce87d5c8b3e1f7db0d4e3f"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.615335 16880 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260808 05:08:10.615981 16908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.616109 16880 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.616190 16880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "7a2a954ca3d44e52b20208acbb0a05e0"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "af8f0a39c1d36a3b12215ade50ed31f1"
server_key_iv: "b1ac976cd7ce87d5c8b3e1f7db0d4e3f"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.616254 16880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:10.635380 16880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:10.636978 16880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:10.637104 16880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:10.640813 16880 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:40661
I20260808 05:08:10.640861 16984 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:40661 every 8 connection(s)
I20260808 05:08:10.641166 16880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:10.642027 16985 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:10.642321 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 16880
I20260808 05:08:10.642403 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:10.642570 13292 external_mini_cluster.cc:1428] Setting key 85a52013ebf94011380b70f47ac71bdb
I20260808 05:08:10.644793 16985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0: Bootstrap starting.
I20260808 05:08:10.645416 16985 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:10.645663 16985 log.cc:824] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:10.646361 16985 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0: No bootstrap required, opened a new log
I20260808 05:08:10.648617 16985 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40661 } }
I20260808 05:08:10.648747 16985 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:10.648767 16985 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a2a954ca3d44e52b20208acbb0a05e0, State: Initialized, Role: FOLLOWER
I20260808 05:08:10.648871 16985 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40661 } }
I20260808 05:08:10.648936 16985 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:10.648967 16985 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:10.649011 16985 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 05:08:10 dist-test-slave-bndk krb5kdc[16855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165690, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:10.649587 16985 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40661 } }
I20260808 05:08:10.649696 16985 leader_election.cc:302] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a2a954ca3d44e52b20208acbb0a05e0; no voters:
I20260808 05:08:10.649858 16985 leader_election.cc:288] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:10.649933 16993 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:10.650086 16993 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [term 1 LEADER]: Becoming Leader. State: Replica: 7a2a954ca3d44e52b20208acbb0a05e0, State: Running, Role: LEADER
I20260808 05:08:10.650141 16985 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:10.650199 16993 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40661 } }
I20260808 05:08:10.650578 16996 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a2a954ca3d44e52b20208acbb0a05e0. Latest consensus state: current_term: 1 leader_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40661 } } }
I20260808 05:08:10.650707 16995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a2a954ca3d44e52b20208acbb0a05e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40661 } } }
I20260808 05:08:10.650883 16995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:10.650664 16996 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:10.651454 17008 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:10.652307 17008 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:10.653009 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:10.643154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59608 (local address 127.12.251.62:40661)
0808 05:08:10.643328 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:10.643336 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:10.643360 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:08:10.643804 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:10.643810 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:10.643855 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:10.643971 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:10.644708 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.645656 (+ 948us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.646604 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.646992 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.647074 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:10.649597 (+ 2523us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:10.649601 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:10.649602 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:10.649615 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:10.651635 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:10.651984 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:10.651987 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:10.651987 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:10.652066 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:10.652250 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:10.652251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:10.652251 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:10.652475 (+ 224us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:10.652614 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:10.652721 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:08:10.652848 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260808 05:08:10.654049 17008 catalog_manager.cc:1347] Generated new cluster ID: c0c4478774f745c7a041f490a1f1e061
I20260808 05:08:10.654105 17008 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:10.671913 17008 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:10.672632 17008 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:10.675812 17008 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a2a954ca3d44e52b20208acbb0a05e0: Generated new TSK 0
I20260808 05:08:10.675983 17008 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:10.706086 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40661
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:10.787117 17025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:10.787314 17025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:10.787335 17025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:10.788457 17025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:10.788496 17025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:10.788525 17025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:10.789976 17025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17025
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:10.790208 17025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:10.790421 17025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:10.795262 17035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:10.795234 17039 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:10.795401 17025 server_base.cc:1034] running on GCE node
W20260808 05:08:10.795241 17034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:10.795702 17025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:10.795905 17025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:10.797039 17025 hybrid_clock.cc:648] HybridClock initialized: now 1786165690797025 us; error 28 us; skew 500 ppm
Aug 08 05:08:10 dist-test-slave-bndk krb5kdc[16855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165690, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:10.799485 17025 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:10.799906 17025 webserver.cc:460] Webserver started at http://127.12.251.1:40517/ using document root <none> and password file <none>
I20260808 05:08:10.800115 17025 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:10.800158 17025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:10.800285 17025 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:10.801378 17025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "1b7a0d93009442e3a787607e32fe173f"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "7e163f50609386c6ce59d30939ab29e5"
server_key_iv: "7224dd64825ee081c97f60a2ae78cd7e"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.801738 17025 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "1b7a0d93009442e3a787607e32fe173f"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "7e163f50609386c6ce59d30939ab29e5"
server_key_iv: "7224dd64825ee081c97f60a2ae78cd7e"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.802994 17025 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:08:10.803617 17048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.803774 17025 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:10.803856 17025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "1b7a0d93009442e3a787607e32fe173f"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "7e163f50609386c6ce59d30939ab29e5"
server_key_iv: "7224dd64825ee081c97f60a2ae78cd7e"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.803910 17025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:10.814415 17025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:10.816368 17025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:10.816475 17025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:10.816638 17025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:10.816886 17025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:10.816915 17025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.816934 17025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:10.816958 17025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.822505 17025 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:37055
I20260808 05:08:10.822556 17219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:37055 every 8 connection(s)
I20260808 05:08:10.822825 17025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:08:10 dist-test-slave-bndk krb5kdc[16855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165690, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:10.831146 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:10.823556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:42037 (local address 127.12.251.62:40661)
0808 05:08:10.823596 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:10.823598 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:10.823802 (+ 204us) server_negotiation.cc:407] Connection header received
0808 05:08:10.824282 (+ 480us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:10.824284 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:10.824295 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:10.824342 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:10.825252 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.825745 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.826684 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.826890 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.826952 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:10.828886 (+ 1934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:10.828887 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:10.828887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:10.828894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:10.830118 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:10.830458 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:10.830459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:10.830459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:10.830504 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:10.830678 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:10.830678 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:10.830678 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:10.830768 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:10.830812 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:10.831008 (+ 196us) server_negotiation.cc:299] Negotiation successful
0808 05:08:10.831071 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:08:10.831286 17223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:10.823540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:40661 (local address 127.12.251.1:42037)
0808 05:08:10.823694 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:10.823728 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:10.824192 (+ 464us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:10.824419 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:10.824424 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:10.824960 (+ 536us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:10.825138 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:10.825143 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.825829 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.825830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:10.826605 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:10.826607 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.826957 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.826957 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:10.827078 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:10.827476 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:10.827485 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:10.828806 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:10.830186 (+ 1380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:10.830190 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:10.830192 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:10.830400 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:10.830549 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:10.830550 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:10.830550 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:10.830637 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:10.830809 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:10.830812 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:10.830916 (+ 104us) client_negotiation.cc:769] Sending connection context
0808 05:08:10.830990 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:08:10.831104 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260808 05:08:10.831310 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 17025
I20260808 05:08:10.831393 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:10.831566 13292 external_mini_cluster.cc:1428] Setting key 543c157a4ab9acece473f923138103cf
I20260808 05:08:10.831912 17220 heartbeater.cc:347] Connected to a master server at 127.12.251.62:40661
I20260808 05:08:10.832010 17220 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:10.832190 17220 heartbeater.cc:511] Master 127.12.251.62:40661 requested a full tablet report, sending...
I20260808 05:08:10.832746 16933 ts_manager.cc:194] Registered new tserver with Master: 1b7a0d93009442e3a787607e32fe173f (127.12.251.1:37055)
I20260808 05:08:10.833400 16933 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:42037
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:10.856113 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40661
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:10.937598 17226 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:10.937793 17226 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:10.937814 17226 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:10.938926 17226 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:10.938966 17226 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:10.938995 17226 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:10.940472 17226 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17226
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:10.940690 17226 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:10.940894 17226 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:10.945641 17232 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:10.945720 17226 server_base.cc:1034] running on GCE node
W20260808 05:08:10.945703 17231 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:10.945703 17234 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:10.946063 17226 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:10.946303 17226 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:10.947460 17226 hybrid_clock.cc:648] HybridClock initialized: now 1786165690947440 us; error 29 us; skew 500 ppm
Aug 08 05:08:10 dist-test-slave-bndk krb5kdc[16855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165690, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:10.949826 17226 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:10.950340 17226 webserver.cc:460] Webserver started at http://127.12.251.2:37121/ using document root <none> and password file <none>
I20260808 05:08:10.950569 17226 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:10.950616 17226 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:10.950747 17226 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:10.951838 17226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "4299315f512e40ee87a3f0d8a59a7cf3"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "d9e5db89296f8ecb4e16de15235680a0"
server_key_iv: "31d24664ddcf1714b121823ef18827ec"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.952181 17226 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "4299315f512e40ee87a3f0d8a59a7cf3"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "d9e5db89296f8ecb4e16de15235680a0"
server_key_iv: "31d24664ddcf1714b121823ef18827ec"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.953467 17226 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:08:10.954118 17248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.954267 17226 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.954348 17226 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "4299315f512e40ee87a3f0d8a59a7cf3"
format_stamp: "Formatted at 2026-08-08 05:08:10 on dist-test-slave-bndk"
server_key: "d9e5db89296f8ecb4e16de15235680a0"
server_key_iv: "31d24664ddcf1714b121823ef18827ec"
server_key_version: "encryptionkey@0"
I20260808 05:08:10.954414 17226 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:10.971843 17226 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:10.973479 17226 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:10.973609 17226 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:10.973814 17226 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:10.974098 17226 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:10.974131 17226 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.974159 17226 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:10.974182 17226 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:10.979588 17226 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:39723
I20260808 05:08:10.979624 17429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:39723 every 8 connection(s)
I20260808 05:08:10.979911 17226 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:10.980654 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 17226
I20260808 05:08:10.980753 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:10.980966 13292 external_mini_cluster.cc:1428] Setting key f3cff1a30345a4e1643cf43f097caa8a
Aug 08 05:08:10 dist-test-slave-bndk krb5kdc[16855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165690, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:10.989524 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:10.980562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:39083 (local address 127.12.251.62:40661)
0808 05:08:10.980626 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:10.980628 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:10.980836 (+ 208us) server_negotiation.cc:407] Connection header received
0808 05:08:10.981479 (+ 643us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:10.981480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:10.981489 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:10.981535 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:10.982681 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.983165 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.984226 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.984503 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.984567 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:10.986903 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:10.986905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:10.986905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:10.986912 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:10.988142 (+ 1230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:10.988605 (+ 463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:10.988605 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:10.988606 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:10.988651 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:10.988895 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:10.988895 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:10.988896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:10.988989 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:10.989035 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:10.989393 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 05:08:10.989458 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:08:10.989770 17433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:10.980516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:40661 (local address 127.12.251.2:39083)
0808 05:08:10.980679 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:10.980756 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:10.981375 (+ 619us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:10.981608 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:10.981612 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:10.982315 (+ 703us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:10.982593 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:10.982600 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.983252 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.983253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:10.984137 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:10.984140 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:10.984583 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:10.984584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:10.984687 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:10.985153 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:10.985162 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:10.986791 (+ 1629us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:10.988223 (+ 1432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:10.988231 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:10.988233 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:10.988530 (+ 297us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:10.988705 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:10.988705 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:10.988706 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:10.988838 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:10.989045 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:10.989050 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:10.989209 (+ 159us) client_negotiation.cc:769] Sending connection context
0808 05:08:10.989379 (+ 170us) client_negotiation.cc:240] Negotiation successful
0808 05:08:10.989546 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":82,"threads_started":1}
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
I20260808 05:08:10.990286 17430 heartbeater.cc:347] Connected to a master server at 127.12.251.62:40661
I20260808 05:08:10.990387 17430 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:10.990561 17430 heartbeater.cc:511] Master 127.12.251.62:40661 requested a full tablet report, sending...
I20260808 05:08:10.990921 16933 ts_manager.cc:194] Registered new tserver with Master: 4299315f512e40ee87a3f0d8a59a7cf3 (127.12.251.2:39723)
I20260808 05:08:10.991303 16933 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:39083
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:11.005818 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40661
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45761
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:11.086946 17439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:11.087146 17439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:11.087167 17439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:11.088303 17439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:11.088346 17439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:11.088370 17439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:11.089839 17439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45761
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40661
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:11.090061 17439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:11.090269 17439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:11.095147 17450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:11.095176 17453 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:11.095204 17439 server_base.cc:1034] running on GCE node
W20260808 05:08:11.095187 17451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:11.095572 17439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:11.095768 17439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:11.096922 17439 hybrid_clock.cc:648] HybridClock initialized: now 1786165691096909 us; error 30 us; skew 500 ppm
Aug 08 05:08:11 dist-test-slave-bndk krb5kdc[16855](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165691, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:11.099438 17439 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:11.099846 17439 webserver.cc:460] Webserver started at http://127.12.251.3:40361/ using document root <none> and password file <none>
I20260808 05:08:11.100047 17439 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:11.100101 17439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:11.100230 17439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:11.101282 17439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "ca3c2efb0632423e930ac7e601b2a04d"
format_stamp: "Formatted at 2026-08-08 05:08:11 on dist-test-slave-bndk"
server_key: "e46a115c576718ba81efb170a9a922ea"
server_key_iv: "7b8e5d75edab0464c117957755d91356"
server_key_version: "encryptionkey@0"
I20260808 05:08:11.101619 17439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "ca3c2efb0632423e930ac7e601b2a04d"
format_stamp: "Formatted at 2026-08-08 05:08:11 on dist-test-slave-bndk"
server_key: "e46a115c576718ba81efb170a9a922ea"
server_key_iv: "7b8e5d75edab0464c117957755d91356"
server_key_version: "encryptionkey@0"
I20260808 05:08:11.102844 17439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:11.103505 17464 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:11.103657 17439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:11.103739 17439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "ca3c2efb0632423e930ac7e601b2a04d"
format_stamp: "Formatted at 2026-08-08 05:08:11 on dist-test-slave-bndk"
server_key: "e46a115c576718ba81efb170a9a922ea"
server_key_iv: "7b8e5d75edab0464c117957755d91356"
server_key_version: "encryptionkey@0"
I20260808 05:08:11.103802 17439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:11.123697 17439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:11.125942 17439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:11.126075 17439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:11.126283 17439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:11.126606 17439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:11.126643 17439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:11.126665 17439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:11.126677 17439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:11.132177 17439 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:41279
I20260808 05:08:11.132215 17657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:41279 every 8 connection(s)
I20260808 05:08:11.132525 17439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:08:11 dist-test-slave-bndk krb5kdc[16855](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165691, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:11.140836 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 17439
I20260808 05:08:11.140971 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:11.141028 16990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:11.133199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:56729 (local address 127.12.251.62:40661)
0808 05:08:11.133268 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:11.133270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:11.133463 (+ 193us) server_negotiation.cc:407] Connection header received
0808 05:08:11.133959 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:11.133960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:11.133973 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:11.134032 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:11.134932 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:11.135419 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:11.136374 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:11.136567 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:11.136619 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:11.138625 (+ 2006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:11.138627 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:11.138627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:11.138633 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:11.139846 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:11.140183 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:11.140184 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:11.140184 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:11.140229 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:11.140406 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:11.140407 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:11.140407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:11.140510 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:11.140556 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:11.140861 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 05:08:11.140935 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:08:11.141185 13292 external_mini_cluster.cc:1428] Setting key ce403b767d4d3290abc59b5a838308c0
I20260808 05:08:11.141252 17661 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:11.133167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:40661 (local address 127.12.251.3:56729)
0808 05:08:11.133348 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:11.133384 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:11.133863 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:11.134106 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:11.134110 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:11.134653 (+ 543us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:11.134840 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:11.134845 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:11.135506 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:11.135507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:11.136294 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:11.136296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:11.136634 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:11.136635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:11.136752 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:11.137159 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:11.137168 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:11.138538 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:11.139919 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:11.139925 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:11.139927 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:11.140127 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:11.140273 (+ 146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:11.140274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:11.140274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:11.140359 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:11.140560 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:11.140565 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:11.140718 (+ 153us) client_negotiation.cc:769] Sending connection context
0808 05:08:11.140838 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 05:08:11.141013 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260808 05:08:11.141702 17659 heartbeater.cc:347] Connected to a master server at 127.12.251.62:40661
I20260808 05:08:11.141798 17659 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:11.141979 17659 heartbeater.cc:511] Master 127.12.251.62:40661 requested a full tablet report, sending...
I20260808 05:08:11.142349 16933 ts_manager.cc:194] Registered new tserver with Master: ca3c2efb0632423e930ac7e601b2a04d (127.12.251.3:41279)
I20260808 05:08:11.142704 16933 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:56729
I20260808 05:08:11.152877 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:08:11.166041 16990 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:11.165113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59618 (local address 127.12.251.62:40661)
0808 05:08:11.165164 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:11.165166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:11.165305 (+ 139us) server_negotiation.cc:407] Connection header received
0808 05:08:11.165380 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:11.165381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:11.165391 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:11.165431 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:11.165980 (+ 549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59618: BlockingRecv error: recv got EOF from 127.0.0.1:59618 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:08:11.166823 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 17025
I20260808 05:08:11.178630 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 17226
I20260808 05:08:11.188613 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 17439
I20260808 05:08:11.220749 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 16880
2026-08-08T05:08:11Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1936 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:11 dist-test-slave-bndk krb5kdc[17677](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:11 dist-test-slave-bndk krb5kdc[17677](info): set up 2 sockets
Aug 08 05:08:11 dist-test-slave-bndk krb5kdc[17677](info): commencing operation
krb5kdc: starting...
W20260808 05:08:12.373507 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.130s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:12 dist-test-slave-bndk krb5kdc[17677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:12.488862 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:32925
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:37553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:32925
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:12.568783 17697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:12.568982 17697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:12.569005 17697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:12.570160 17697 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:12.570202 17697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:12.570215 17697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:12.570237 17697 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:12.570261 17697 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:12.571794 17697 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:37553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:32925
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:32925
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17697
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:12.572024 17697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:12.572229 17697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:12.576771 17708 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:12.576853 17707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:12.576958 17697 server_base.cc:1034] running on GCE node
W20260808 05:08:12.577059 17710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:12.577332 17697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:12.577611 17697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:12.578763 17697 hybrid_clock.cc:648] HybridClock initialized: now 1786165692578749 us; error 32 us; skew 500 ppm
Aug 08 05:08:12 dist-test-slave-bndk krb5kdc[17677](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165692, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:12.584340 17697 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:12.584743 17697 webserver.cc:460] Webserver started at http://127.12.251.62:42873/ using document root <none> and password file <none>
I20260808 05:08:12.584924 17697 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:12.584965 17697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:12.585050 17697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:12.586094 17697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "859c1a8692274cc7a4aa4e1e78f164b8"
format_stamp: "Formatted at 2026-08-08 05:08:12 on dist-test-slave-bndk"
server_key: "46c247dd15cf6257521434ca7a71cc75"
server_key_iv: "547ac1dd5dbe54ad12b140fbf6a0a852"
server_key_version: "encryptionkey@0"
I20260808 05:08:12.586391 17697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "859c1a8692274cc7a4aa4e1e78f164b8"
format_stamp: "Formatted at 2026-08-08 05:08:12 on dist-test-slave-bndk"
server_key: "46c247dd15cf6257521434ca7a71cc75"
server_key_iv: "547ac1dd5dbe54ad12b140fbf6a0a852"
server_key_version: "encryptionkey@0"
I20260808 05:08:12.587597 17697 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:12.588222 17723 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:12.588403 17697 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:12.588488 17697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "859c1a8692274cc7a4aa4e1e78f164b8"
format_stamp: "Formatted at 2026-08-08 05:08:12 on dist-test-slave-bndk"
server_key: "46c247dd15cf6257521434ca7a71cc75"
server_key_iv: "547ac1dd5dbe54ad12b140fbf6a0a852"
server_key_version: "encryptionkey@0"
I20260808 05:08:12.588541 17697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:12.600167 17697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:12.601832 17697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:12.601938 17697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:12.605746 17697 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:32925
I20260808 05:08:12.605780 17801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:32925 every 8 connection(s)
I20260808 05:08:12.606287 17697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:12.606936 17802 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:12.609159 17802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8: Bootstrap starting.
I20260808 05:08:12.609753 17802 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:12.610025 17802 log.cc:824] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:12.610638 17802 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8: No bootstrap required, opened a new log
I20260808 05:08:12.612206 17802 raft_consensus.cc:348] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32925 } }
I20260808 05:08:12.612339 17802 raft_consensus.cc:374] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:12.612372 17802 raft_consensus.cc:729] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 859c1a8692274cc7a4aa4e1e78f164b8, State: Initialized, Role: FOLLOWER
I20260808 05:08:12.612509 17802 consensus_queue.cc:260] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32925 } }
I20260808 05:08:12.612567 17802 raft_consensus.cc:388] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:12.612589 17802 raft_consensus.cc:482] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:12.612633 17802 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:12.613189 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 17697
I20260808 05:08:12.613364 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:12.613556 13292 external_mini_cluster.cc:1428] Setting key 6ce86df73fe5487d783e1ee0505be65f
I20260808 05:08:12.613682 17802 raft_consensus.cc:504] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32925 } }
I20260808 05:08:12.613787 17802 leader_election.cc:302] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 859c1a8692274cc7a4aa4e1e78f164b8; no voters:
I20260808 05:08:12.613950 17802 leader_election.cc:288] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:12.614012 17807 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:12.614223 17807 raft_consensus.cc:686] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [term 1 LEADER]: Becoming Leader. State: Replica: 859c1a8692274cc7a4aa4e1e78f164b8, State: Running, Role: LEADER
I20260808 05:08:12.614303 17802 sys_catalog.cc:564] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:12.614390 17807 consensus_queue.cc:237] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32925 } }
I20260808 05:08:12.614741 17811 sys_catalog.cc:455] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32925 } } }
I20260808 05:08:12.614816 17811 sys_catalog.cc:458] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:12.615015 17812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 859c1a8692274cc7a4aa4e1e78f164b8. Latest consensus state: current_term: 1 leader_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "859c1a8692274cc7a4aa4e1e78f164b8" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32925 } } }
I20260808 05:08:12.615097 17812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:12.615432 17819 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:12.617704 17819 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:12.619081 17819 catalog_manager.cc:1347] Generated new cluster ID: a70f43ed9f6b47c1a1e316baaf9d7fd8
I20260808 05:08:12.619129 17819 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:08:12 dist-test-slave-bndk krb5kdc[17677](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165692, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:12.625075 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:12.614001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53894 (local address 127.12.251.62:32925)
0808 05:08:12.614195 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:12.614206 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:12.614269 (+ 63us) server_negotiation.cc:407] Connection header received
0808 05:08:12.614402 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:12.614409 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:12.614468 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:12.614647 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:12.615519 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:12.616948 (+ 1429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:12.617794 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:12.618273 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:12.618372 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:12.621151 (+ 2779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:12.621156 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:12.621156 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:12.621169 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:12.623014 (+ 1845us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:12.623407 (+ 393us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:12.623410 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:12.623410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:12.623532 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:12.623733 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:12.623734 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:12.623734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:12.624056 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:12.624218 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:12.624725 (+ 507us) server_negotiation.cc:299] Negotiation successful
0808 05:08:12.624861 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":79,"threads_started":1}
I20260808 05:08:12.625916 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:08:12.634729 17819 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:12.635219 17819 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:12.645246 17819 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 859c1a8692274cc7a4aa4e1e78f164b8: Generated new TSK 0
I20260808 05:08:12.645417 17819 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:08:12.646642 17810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:12.642938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53902 (local address 127.12.251.62:32925)
0808 05:08:12.642992 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:12.642994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:12.643122 (+ 128us) server_negotiation.cc:407] Connection header received
0808 05:08:12.643172 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:12.643173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:12.643184 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:12.643244 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:12.643635 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:12.644395 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:12.645204 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:12.645562 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:12.645623 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:12.646201 (+ 578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:12.646202 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:12.646203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:12.646408 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:12.646427 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:12.646434 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:12.646494 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:12.646541 (+ 47us) server_negotiation.cc:299] Negotiation successful
0808 05:08:12.646565 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:08:12.648972 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 17697
2026-08-08T05:08:12Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1431 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:12 dist-test-slave-bndk krb5kdc[17852](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:12 dist-test-slave-bndk krb5kdc[17852](info): set up 2 sockets
Aug 08 05:08:12 dist-test-slave-bndk krb5kdc[17852](info): commencing operation
krb5kdc: starting...
W20260808 05:08:13.780992 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:13 dist-test-slave-bndk krb5kdc[17852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:13.893872 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44547
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:44547
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:13.975574 17870 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:13.975767 17870 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:13.975790 17870 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:13.976915 17870 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:13.976956 17870 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:13.976969 17870 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:13.976994 17870 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:13.977015 17870 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:13.978533 17870 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:44547
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44547
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17870
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:13.978755 17870 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:13.978955 17870 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:13.983485 17882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:13.983494 17880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:13.983641 17876 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:13.983805 17870 server_base.cc:1034] running on GCE node
I20260808 05:08:13.984015 17870 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:13.984284 17870 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:13.985419 17870 hybrid_clock.cc:648] HybridClock initialized: now 1786165693985400 us; error 34 us; skew 500 ppm
Aug 08 05:08:13 dist-test-slave-bndk krb5kdc[17852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165693, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:13.987706 17870 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:13.988122 17870 webserver.cc:460] Webserver started at http://127.12.251.62:46323/ using document root <none> and password file <none>
I20260808 05:08:13.988329 17870 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:13.988376 17870 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:13.988510 17870 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:13.989535 17870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "34e1eb6cf7f34576a27e1aa22491cdab"
format_stamp: "Formatted at 2026-08-08 05:08:13 on dist-test-slave-bndk"
server_key: "fe546349f3c4ca66d07615fb958a1637"
server_key_iv: "4e79873bac183ee7347c3212ce9e8b7d"
server_key_version: "encryptionkey@0"
I20260808 05:08:13.989859 17870 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "34e1eb6cf7f34576a27e1aa22491cdab"
format_stamp: "Formatted at 2026-08-08 05:08:13 on dist-test-slave-bndk"
server_key: "fe546349f3c4ca66d07615fb958a1637"
server_key_iv: "4e79873bac183ee7347c3212ce9e8b7d"
server_key_version: "encryptionkey@0"
I20260808 05:08:13.991048 17870 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:13.991690 17895 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:13.991834 17870 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:13.991917 17870 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "34e1eb6cf7f34576a27e1aa22491cdab"
format_stamp: "Formatted at 2026-08-08 05:08:13 on dist-test-slave-bndk"
server_key: "fe546349f3c4ca66d07615fb958a1637"
server_key_iv: "4e79873bac183ee7347c3212ce9e8b7d"
server_key_version: "encryptionkey@0"
I20260808 05:08:13.991976 17870 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:14.007501 17870 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:14.009194 17870 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:14.009377 17870 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:14.013316 17870 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:44547
I20260808 05:08:14.013358 17970 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:44547 every 8 connection(s)
I20260808 05:08:14.013692 17870 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:14.014839 17971 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:14.017027 17971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab: Bootstrap starting.
I20260808 05:08:14.017604 17971 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:14.017830 17971 log.cc:824] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:14.018326 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 17870
I20260808 05:08:14.018428 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:14.018553 17971 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab: No bootstrap required, opened a new log
I20260808 05:08:14.018635 13292 external_mini_cluster.cc:1428] Setting key d47e4963d9eee04cfa5c3fd1bfa03c1d
I20260808 05:08:14.020738 17971 raft_consensus.cc:348] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44547 } }
I20260808 05:08:14.020884 17971 raft_consensus.cc:374] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:14.020917 17971 raft_consensus.cc:729] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34e1eb6cf7f34576a27e1aa22491cdab, State: Initialized, Role: FOLLOWER
I20260808 05:08:14.021042 17971 consensus_queue.cc:260] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44547 } }
I20260808 05:08:14.021101 17971 raft_consensus.cc:388] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:14.021130 17971 raft_consensus.cc:482] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:14.021178 17971 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:14.021708 17971 raft_consensus.cc:504] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44547 } }
I20260808 05:08:14.021802 17971 leader_election.cc:302] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34e1eb6cf7f34576a27e1aa22491cdab; no voters:
I20260808 05:08:14.021957 17971 leader_election.cc:288] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:14.021983 17982 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:14.022096 17982 raft_consensus.cc:686] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [term 1 LEADER]: Becoming Leader. State: Replica: 34e1eb6cf7f34576a27e1aa22491cdab, State: Running, Role: LEADER
I20260808 05:08:14.022209 17971 sys_catalog.cc:564] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:14.022235 17982 consensus_queue.cc:237] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44547 } }
I20260808 05:08:14.022624 17982 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34e1eb6cf7f34576a27e1aa22491cdab. Latest consensus state: current_term: 1 leader_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44547 } } }
I20260808 05:08:14.022706 17983 sys_catalog.cc:455] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34e1eb6cf7f34576a27e1aa22491cdab" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44547 } } }
I20260808 05:08:14.022768 17983 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:14.022749 17982 sys_catalog.cc:458] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:14.023150 18001 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:14.023653 18001 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:14.025259 18001 catalog_manager.cc:1347] Generated new cluster ID: 701ff55b70ce4bf0b80344561b9fa9c0
I20260808 05:08:14.025309 18001 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165693, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:14.029815 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.019135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42510 (local address 127.12.251.62:44547)
0808 05:08:14.019323 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:14.019332 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:14.019357 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:08:14.019830 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:14.019837 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:14.019885 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:14.020001 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:14.020746 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.022022 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.023037 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.023571 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.023971 (+ 400us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.026375 (+ 2404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:14.026380 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:14.026381 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:14.026392 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:14.028226 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.028639 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.028642 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.028642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.028740 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.028928 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.028929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.028929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.029202 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:14.029362 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:14.029490 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 05:08:14.029618 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":94,"threads_started":1}
I20260808 05:08:14.038337 18001 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:14.038817 18001 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:14.042961 18001 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 34e1eb6cf7f34576a27e1aa22491cdab: Generated new TSK 0
I20260808 05:08:14.043133 18001 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:14.075817 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:44547
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:14.157481 18018 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:14.157680 18018 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:14.157703 18018 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:14.158851 18018 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:14.158905 18018 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:14.158950 18018 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:14.160424 18018 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:44547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18018
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:14.160648 18018 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:14.160858 18018 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:14.165575 18024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:14.165596 18027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:14.165596 18023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:14.165841 18018 server_base.cc:1034] running on GCE node
I20260808 05:08:14.166046 18018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:14.166267 18018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:14.167407 18018 hybrid_clock.cc:648] HybridClock initialized: now 1786165694167390 us; error 29 us; skew 500 ppm
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:14.169862 18018 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:14.170279 18018 webserver.cc:460] Webserver started at http://127.12.251.1:37429/ using document root <none> and password file <none>
I20260808 05:08:14.170486 18018 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:14.170535 18018 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:14.170662 18018 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:14.171727 18018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "cc1884f54fc845c59328d20fec59d4f6"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "f0f256de0fcb1a3f9fe97623b008fe93"
server_key_iv: "9d3a8a75b18d92fe60e3d928c86d2780"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.172070 18018 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "cc1884f54fc845c59328d20fec59d4f6"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "f0f256de0fcb1a3f9fe97623b008fe93"
server_key_iv: "9d3a8a75b18d92fe60e3d928c86d2780"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.173322 18018 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:08:14.173974 18038 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.174125 18018 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:14.174207 18018 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "cc1884f54fc845c59328d20fec59d4f6"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "f0f256de0fcb1a3f9fe97623b008fe93"
server_key_iv: "9d3a8a75b18d92fe60e3d928c86d2780"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.174273 18018 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:14.205405 18018 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:14.207293 18018 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:14.207432 18018 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:14.207659 18018 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:14.207991 18018 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:14.208027 18018 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.208051 18018 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:14.208074 18018 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.213728 18018 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:36533
I20260808 05:08:14.213798 18204 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:36533 every 8 connection(s)
I20260808 05:08:14.214112 18018 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:14.221490 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 18018
I20260808 05:08:14.221596 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:14.221777 13292 external_mini_cluster.cc:1428] Setting key dad87cf425e13015b5c35c099a22d4b9
I20260808 05:08:14.222896 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.214842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:55029 (local address 127.12.251.62:44547)
0808 05:08:14.214923 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:14.214925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:14.215084 (+ 159us) server_negotiation.cc:407] Connection header received
0808 05:08:14.215572 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:14.215573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:14.215583 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:14.215634 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:14.216549 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.217065 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.218040 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.218228 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.218277 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.220210 (+ 1933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:14.220212 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:14.220212 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:14.220218 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:14.221376 (+ 1158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.221828 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.221830 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.221830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.221896 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.222186 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.222187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.222187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.222315 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:14.222382 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:14.222701 (+ 319us) server_negotiation.cc:299] Negotiation successful
0808 05:08:14.222817 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260808 05:08:14.223085 18211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.214808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:44547 (local address 127.12.251.1:55029)
0808 05:08:14.214969 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:14.215006 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:14.215497 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:14.215691 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:14.215694 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:14.216250 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:14.216457 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:14.216462 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.217130 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.217130 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:14.217979 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:14.217981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.218286 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.218287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:14.218385 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.218814 (+ 429us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:14.218822 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:14.220130 (+ 1308us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:14.221455 (+ 1325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:14.221464 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:14.221467 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:14.221752 (+ 285us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:14.221976 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:14.221977 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:14.221977 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:14.222121 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:14.222378 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:14.222385 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:14.222559 (+ 174us) client_negotiation.cc:769] Sending connection context
0808 05:08:14.222679 (+ 120us) client_negotiation.cc:240] Negotiation successful
0808 05:08:14.222854 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":82,"threads_started":1}
I20260808 05:08:14.223616 18205 heartbeater.cc:347] Connected to a master server at 127.12.251.62:44547
I20260808 05:08:14.223717 18205 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:14.223946 18205 heartbeater.cc:511] Master 127.12.251.62:44547 requested a full tablet report, sending...
I20260808 05:08:14.224488 17915 ts_manager.cc:194] Registered new tserver with Master: cc1884f54fc845c59328d20fec59d4f6 (127.12.251.1:36533)
I20260808 05:08:14.225112 17915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:55029
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:14.246227 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:44547
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:14.326974 18224 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:14.327179 18224 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:14.327201 18224 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:14.328302 18224 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:14.328343 18224 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:14.328368 18224 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:14.329777 18224 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:44547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18224
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:14.329957 18224 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:14.330139 18224 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:14.335075 18232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:14.335120 18237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:14.335258 18224 server_base.cc:1034] running on GCE node
W20260808 05:08:14.335453 18235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:14.335657 18224 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:14.335865 18224 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:14.337004 18224 hybrid_clock.cc:648] HybridClock initialized: now 1786165694336993 us; error 31 us; skew 500 ppm
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:14.339483 18224 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:14.339948 18224 webserver.cc:460] Webserver started at http://127.12.251.2:38041/ using document root <none> and password file <none>
I20260808 05:08:14.340164 18224 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:14.340211 18224 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:14.340339 18224 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:14.341383 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "3656d3e2ed714d548932b410bb603715"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "9ea53d1f14b62dc9f95773178626ab59"
server_key_iv: "f449ee64494aa25a81af9d09eadb1434"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.341719 18224 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "3656d3e2ed714d548932b410bb603715"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "9ea53d1f14b62dc9f95773178626ab59"
server_key_iv: "f449ee64494aa25a81af9d09eadb1434"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.342945 18224 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:14.343592 18245 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.343752 18224 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.343843 18224 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "3656d3e2ed714d548932b410bb603715"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "9ea53d1f14b62dc9f95773178626ab59"
server_key_iv: "f449ee64494aa25a81af9d09eadb1434"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.343904 18224 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:14.360611 18224 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:14.362780 18224 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:14.362915 18224 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:14.363142 18224 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:14.363436 18224 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:14.363472 18224 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.363500 18224 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:14.363517 18224 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.369232 18224 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:45169
I20260808 05:08:14.369285 18430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:45169 every 8 connection(s)
I20260808 05:08:14.369598 18224 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:14.370849 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 18224
I20260808 05:08:14.370940 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:14.371160 13292 external_mini_cluster.cc:1428] Setting key b48f17353e9c07e3d37d593dac0c8173
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:14.379424 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.370326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:57039 (local address 127.12.251.62:44547)
0808 05:08:14.370387 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:14.370389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:14.370566 (+ 177us) server_negotiation.cc:407] Connection header received
0808 05:08:14.371097 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:14.371099 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:14.371113 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:14.371196 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:14.372233 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.372904 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.374161 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.374347 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.374399 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.376686 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:14.376688 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:14.376689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:14.376698 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:14.378160 (+ 1462us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.378534 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.378535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.378535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.378603 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.378816 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.378817 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.378817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.378956 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:14.379033 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:14.379245 (+ 212us) server_negotiation.cc:299] Negotiation successful
0808 05:08:14.379329 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:08:14.379504 18435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.370289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:44547 (local address 127.12.251.2:57039)
0808 05:08:14.370438 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:14.370480 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:14.370995 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:14.371274 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:14.371279 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:14.371952 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:14.372148 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:14.372153 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.372986 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.372987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:14.374084 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:14.374088 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.374420 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.374421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:14.374560 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.375030 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:14.375038 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:14.376568 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:14.378235 (+ 1667us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:14.378241 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:14.378243 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:14.378468 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:14.378671 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:14.378672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:14.378672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:14.378762 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:14.379019 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:14.379022 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:14.379129 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 05:08:14.379201 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:08:14.379318 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":79,"threads_started":1}
I20260808 05:08:14.379961 18432 heartbeater.cc:347] Connected to a master server at 127.12.251.62:44547
I20260808 05:08:14.380051 18432 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:14.380228 18432 heartbeater.cc:511] Master 127.12.251.62:44547 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
I20260808 05:08:14.380673 17915 ts_manager.cc:194] Registered new tserver with Master: 3656d3e2ed714d548932b410bb603715 (127.12.251.2:45169)
I20260808 05:08:14.381031 17915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:57039
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:14.396030 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:44547
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:37205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:14.475535 18439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:14.475729 18439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:14.475759 18439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:14.476928 18439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:14.476976 18439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:14.477012 18439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:14.478493 18439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:37205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:44547
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18439
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:14.478725 18439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:14.478943 18439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:14.483649 18450 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:14.483742 18454 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:14.483779 18439 server_base.cc:1034] running on GCE node
W20260808 05:08:14.483701 18451 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:14.484035 18439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:14.484249 18439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:14.485395 18439 hybrid_clock.cc:648] HybridClock initialized: now 1786165694485375 us; error 33 us; skew 500 ppm
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:14.487701 18439 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:14.488126 18439 webserver.cc:460] Webserver started at http://127.12.251.3:38327/ using document root <none> and password file <none>
I20260808 05:08:14.488346 18439 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:14.488394 18439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:14.488530 18439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:14.489576 18439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "5313309a6d4b4377a67b9a1f1f112221"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "6bfb4b39d370a3fbfe16f50411540749"
server_key_iv: "d84bf3e2314de48d4f6bb00e2025c79c"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.489897 18439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "5313309a6d4b4377a67b9a1f1f112221"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "6bfb4b39d370a3fbfe16f50411540749"
server_key_iv: "d84bf3e2314de48d4f6bb00e2025c79c"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.491120 18439 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:14.491803 18468 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.491946 18439 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:14.492029 18439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "5313309a6d4b4377a67b9a1f1f112221"
format_stamp: "Formatted at 2026-08-08 05:08:14 on dist-test-slave-bndk"
server_key: "6bfb4b39d370a3fbfe16f50411540749"
server_key_iv: "d84bf3e2314de48d4f6bb00e2025c79c"
server_key_version: "encryptionkey@0"
I20260808 05:08:14.492097 18439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:14.499168 18439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:14.500756 18439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:14.500885 18439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:14.501076 18439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:14.501389 18439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:14.501423 18439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.501451 18439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:14.501475 18439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:14.507270 18439 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:37425
I20260808 05:08:14.507305 18644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:37425 every 8 connection(s)
I20260808 05:08:14.507601 18439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:14.510574 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 18439
I20260808 05:08:14.510670 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:14.510846 13292 external_mini_cluster.cc:1428] Setting key 41d16113f95a89d1d43cdf2e3b7e2d63
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:14.516177 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.508246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:54647 (local address 127.12.251.62:44547)
0808 05:08:14.508298 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:14.508300 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:14.508519 (+ 219us) server_negotiation.cc:407] Connection header received
0808 05:08:14.508962 (+ 443us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:14.508963 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:14.508973 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:14.509044 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:14.509938 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.510439 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.511692 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.511900 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.511955 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.513898 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:14.513900 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:14.513900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:14.513908 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:14.514929 (+ 1021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.515301 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.515302 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.515303 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.515356 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.515581 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.515582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.515582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.515686 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:14.515760 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:14.516006 (+ 246us) server_negotiation.cc:299] Negotiation successful
0808 05:08:14.516088 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:14.516314 18649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.508219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:44547 (local address 127.12.251.3:54647)
0808 05:08:14.508377 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:14.508410 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:14.508881 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:14.509107 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:14.509110 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:14.509683 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:14.509864 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:14.509869 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.510539 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.510540 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:14.511630 (+ 1090us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:14.511633 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.511972 (+ 339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.511973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:14.512110 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.512515 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:14.512523 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:14.513811 (+ 1288us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:14.515019 (+ 1208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:14.515026 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:14.515028 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:14.515235 (+ 207us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:14.515414 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:14.515415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:14.515415 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:14.515525 (+ 110us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:14.515742 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:14.515748 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:14.515882 (+ 134us) client_negotiation.cc:769] Sending connection context
0808 05:08:14.515969 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:08:14.516116 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":87,"threads_started":1}
I20260808 05:08:14.516732 18646 heartbeater.cc:347] Connected to a master server at 127.12.251.62:44547
I20260808 05:08:14.516816 18646 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:14.516990 18646 heartbeater.cc:511] Master 127.12.251.62:44547 requested a full tablet report, sending...
I20260808 05:08:14.517324 17915 ts_manager.cc:194] Registered new tserver with Master: 5313309a6d4b4377a67b9a1f1f112221 (127.12.251.3:37425)
I20260808 05:08:14.517663 17915 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:54647
I20260808 05:08:14.522316 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[17852](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165694, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:14.544071 17980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:14.537807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42522 (local address 127.12.251.62:44547)
0808 05:08:14.537869 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:14.537872 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:14.537930 (+ 58us) server_negotiation.cc:407] Connection header received
0808 05:08:14.538027 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:14.538028 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:14.538039 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:14.538089 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:14.538600 (+ 511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.539084 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.539762 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:14.539948 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:14.540003 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:14.542003 (+ 2000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:14.542005 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:14.542005 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:14.542012 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:14.543098 (+ 1086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.543413 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.543414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.543415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.543474 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:14.543633 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:14.543633 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:14.543633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:14.543764 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:14.543838 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:14.543911 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 05:08:14.543990 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260808 05:08:14.544292 17915 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42522
I20260808 05:08:14.544646 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 18018
I20260808 05:08:14.559551 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 18224
I20260808 05:08:14.572947 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 18439
I20260808 05:08:14.583031 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 17870
2026-08-08T05:08:14Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1930 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[18666](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[18666](info): set up 2 sockets
Aug 08 05:08:14 dist-test-slave-bndk krb5kdc[18666](info): commencing operation
krb5kdc: starting...
W20260808 05:08:15.715147 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:15 dist-test-slave-bndk krb5kdc[18666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:15.827740 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:43237
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:43237
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:15.908640 18684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:15.908847 18684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:15.908876 18684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:15.910043 18684 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:15.910085 18684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:15.910102 18684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:15.910118 18684 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:15.910132 18684 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:15.911654 18684 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:43237
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:43237
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:15.911896 18684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:15.912109 18684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:15.916776 18691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:15.916782 18693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:15.916777 18695 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:15.916800 18684 server_base.cc:1034] running on GCE node
I20260808 05:08:15.917246 18684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:15.917542 18684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:15.918685 18684 hybrid_clock.cc:648] HybridClock initialized: now 1786165695918673 us; error 34 us; skew 500 ppm
Aug 08 05:08:15 dist-test-slave-bndk krb5kdc[18666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165695, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:15.921018 18684 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:15.921461 18684 webserver.cc:460] Webserver started at http://127.12.251.62:40107/ using document root <none> and password file <none>
I20260808 05:08:15.921658 18684 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:15.921705 18684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:15.921833 18684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:15.922863 18684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "996538718ccf4ad3a09469767812da75"
format_stamp: "Formatted at 2026-08-08 05:08:15 on dist-test-slave-bndk"
server_key: "ce0eed9a5884bac3fdad21151be72078"
server_key_iv: "eb94c6ad2f59790075a8e0974b8c062b"
server_key_version: "encryptionkey@0"
I20260808 05:08:15.923213 18684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "996538718ccf4ad3a09469767812da75"
format_stamp: "Formatted at 2026-08-08 05:08:15 on dist-test-slave-bndk"
server_key: "ce0eed9a5884bac3fdad21151be72078"
server_key_iv: "eb94c6ad2f59790075a8e0974b8c062b"
server_key_version: "encryptionkey@0"
I20260808 05:08:15.924427 18684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:15.925071 18703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:15.925244 18684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:15.925335 18684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "996538718ccf4ad3a09469767812da75"
format_stamp: "Formatted at 2026-08-08 05:08:15 on dist-test-slave-bndk"
server_key: "ce0eed9a5884bac3fdad21151be72078"
server_key_iv: "eb94c6ad2f59790075a8e0974b8c062b"
server_key_version: "encryptionkey@0"
I20260808 05:08:15.925402 18684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:15.937824 18684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:15.939487 18684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:15.939627 18684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:15.943639 18684 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:43237
I20260808 05:08:15.943671 18794 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:43237 every 8 connection(s)
I20260808 05:08:15.944146 18684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:15.944821 18795 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:15.947142 18795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75: Bootstrap starting.
I20260808 05:08:15.947672 18795 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:15.947914 18795 log.cc:824] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:15.948529 18795 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75: No bootstrap required, opened a new log
I20260808 05:08:15.950129 18795 raft_consensus.cc:348] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996538718ccf4ad3a09469767812da75" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43237 } }
I20260808 05:08:15.950263 18795 raft_consensus.cc:374] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:15.950285 18795 raft_consensus.cc:729] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 996538718ccf4ad3a09469767812da75, State: Initialized, Role: FOLLOWER
I20260808 05:08:15.950392 18795 consensus_queue.cc:260] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996538718ccf4ad3a09469767812da75" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43237 } }
I20260808 05:08:15.950444 18795 raft_consensus.cc:388] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:15.950471 18795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:15.950508 18795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:15.951351 18795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996538718ccf4ad3a09469767812da75" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43237 } }
I20260808 05:08:15.951447 18795 leader_election.cc:302] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 996538718ccf4ad3a09469767812da75; no voters:
I20260808 05:08:15.951592 18795 leader_election.cc:288] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:15.951645 18801 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:15.951807 18801 raft_consensus.cc:686] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [term 1 LEADER]: Becoming Leader. State: Replica: 996538718ccf4ad3a09469767812da75, State: Running, Role: LEADER
I20260808 05:08:15.951830 18795 sys_catalog.cc:564] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:15.951882 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 18684
I20260808 05:08:15.951894 18801 consensus_queue.cc:237] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996538718ccf4ad3a09469767812da75" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43237 } }
I20260808 05:08:15.951989 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:15.952214 13292 external_mini_cluster.cc:1428] Setting key e424c7b072ae90e9d7870b3f31cd0a52
I20260808 05:08:15.952263 18803 sys_catalog.cc:455] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 996538718ccf4ad3a09469767812da75. Latest consensus state: current_term: 1 leader_uuid: "996538718ccf4ad3a09469767812da75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996538718ccf4ad3a09469767812da75" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43237 } } }
I20260808 05:08:15.952297 18802 sys_catalog.cc:455] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "996538718ccf4ad3a09469767812da75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "996538718ccf4ad3a09469767812da75" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43237 } } }
I20260808 05:08:15.952342 18803 sys_catalog.cc:458] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:15.952368 18802 sys_catalog.cc:458] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:15.952572 18810 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:15.953258 18810 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:15.954816 18810 catalog_manager.cc:1347] Generated new cluster ID: 1c24491581f743268d8ad2ce50cd3679
I20260808 05:08:15.954869 18810 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:08:15 dist-test-slave-bndk krb5kdc[18666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165695, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:15.960602 18810 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:15.961199 18810 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:15.964308 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:15.952966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48366 (local address 127.12.251.62:43237)
0808 05:08:15.953940 (+ 974us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:15.953948 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:15.953972 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:08:15.954061 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:15.954066 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:15.954108 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:15.954228 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:15.954971 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:15.956346 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:15.957413 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:15.958042 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:15.958153 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:15.960769 (+ 2616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:15.960772 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:15.960773 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:15.960784 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:15.962748 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:15.963145 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:15.963148 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:15.963148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:15.963259 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:15.963452 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:15.963453 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:15.963453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:15.963697 (+ 244us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:15.963834 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:15.963932 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 05:08:15.964075 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":934,"thread_start_us":95,"threads_started":1}
I20260808 05:08:15.965652 18810 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 996538718ccf4ad3a09469767812da75: Generated new TSK 0
I20260808 05:08:15.965808 18810 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:15.991845 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43237
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:16.071996 18829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:16.072296 18829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:16.072340 18829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:16.073529 18829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:16.073568 18829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:16.073592 18829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:16.075073 18829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18829
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:16.075284 18829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:16.075506 18829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:16.080211 18840 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:16.080204 18836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:16.080201 18837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:16.080394 18829 server_base.cc:1034] running on GCE node
I20260808 05:08:16.080613 18829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:16.080829 18829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:16.081961 18829 hybrid_clock.cc:648] HybridClock initialized: now 1786165696081943 us; error 33 us; skew 500 ppm
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:16.084431 18829 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:16.084873 18829 webserver.cc:460] Webserver started at http://127.12.251.1:40873/ using document root <none> and password file <none>
I20260808 05:08:16.085073 18829 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:16.085122 18829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:16.085276 18829 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:16.086302 18829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "aa0fcb5085b3402b9369029fa2aa44e7"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "9d2f7f08ea292d02917164dc87bd608c"
server_key_iv: "34694618e851a1fe9679663d61807590"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.086647 18829 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "aa0fcb5085b3402b9369029fa2aa44e7"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "9d2f7f08ea292d02917164dc87bd608c"
server_key_iv: "34694618e851a1fe9679663d61807590"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.087874 18829 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:16.088510 18853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.088647 18829 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:16.088732 18829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "aa0fcb5085b3402b9369029fa2aa44e7"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "9d2f7f08ea292d02917164dc87bd608c"
server_key_iv: "34694618e851a1fe9679663d61807590"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.088798 18829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:16.106923 18829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:16.108582 18829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:16.108717 18829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:16.108925 18829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:16.109246 18829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:16.109280 18829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.109308 18829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:16.109325 18829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.114751 18829 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33013
I20260808 05:08:16.114810 19023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33013 every 8 connection(s)
I20260808 05:08:16.115259 18829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:16.116847 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 18829
I20260808 05:08:16.116966 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:16.117178 13292 external_mini_cluster.cc:1428] Setting key b7055522c0030728bb5b4ef6ad974aa6
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:16.124990 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.115947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:36497 (local address 127.12.251.62:43237)
0808 05:08:16.116000 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:16.116002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:16.116171 (+ 169us) server_negotiation.cc:407] Connection header received
0808 05:08:16.117279 (+ 1108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:16.117281 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:16.117300 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:16.117409 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:16.118121 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.118609 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.119876 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.120167 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.120235 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.122445 (+ 2210us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:16.122447 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:16.122448 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:16.122455 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:16.123727 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.124088 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.124089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.124089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.124143 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.124354 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.124355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.124356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.124468 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:16.124526 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:16.124781 (+ 255us) server_negotiation.cc:299] Negotiation successful
0808 05:08:16.124882 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:08:16.125115 19027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.115909 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43237 (local address 127.12.251.1:36497)
0808 05:08:16.116057 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:16.116092 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:16.117143 (+ 1051us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:16.117470 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:16.117475 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:16.117757 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:16.118024 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:16.118031 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.118692 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.118693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:16.119796 (+ 1103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:16.119799 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.120238 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.120239 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:16.120376 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.120842 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:16.120852 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:16.122355 (+ 1503us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:16.123801 (+ 1446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:16.123808 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:16.123810 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:16.124024 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:16.124195 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:16.124196 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:16.124196 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:16.124299 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:16.124522 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:16.124529 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:16.124664 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 05:08:16.124749 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:08:16.124900 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":80,"threads_started":1}
I20260808 05:08:16.125609 19024 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43237
I20260808 05:08:16.125713 19024 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:16.125906 19024 heartbeater.cc:511] Master 127.12.251.62:43237 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
I20260808 05:08:16.126415 18731 ts_manager.cc:194] Registered new tserver with Master: aa0fcb5085b3402b9369029fa2aa44e7 (127.12.251.1:33013)
I20260808 05:08:16.127079 18731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:36497
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:16.143620 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43237
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:16.223284 19033 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:16.223476 19033 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:16.223498 19033 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:16.224563 19033 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:16.224596 19033 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:16.224622 19033 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:16.226073 19033 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19033
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:16.226255 19033 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:16.226437 19033 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:16.231247 19042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:16.231261 19038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:16.231227 19040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:16.231441 19033 server_base.cc:1034] running on GCE node
I20260808 05:08:16.231737 19033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:16.231959 19033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:16.233081 19033 hybrid_clock.cc:648] HybridClock initialized: now 1786165696233074 us; error 30 us; skew 500 ppm
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:16.235488 19033 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:16.235893 19033 webserver.cc:460] Webserver started at http://127.12.251.2:41615/ using document root <none> and password file <none>
I20260808 05:08:16.236089 19033 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:16.236137 19033 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:16.236264 19033 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:16.237313 19033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "e6ffc96255614db1bbbc26f7d377f555"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "47102e88e65fa705d2b02a30bdd0f00b"
server_key_iv: "5f632ae8d7f380d168f4e52dafd058b8"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.237641 19033 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "e6ffc96255614db1bbbc26f7d377f555"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "47102e88e65fa705d2b02a30bdd0f00b"
server_key_iv: "5f632ae8d7f380d168f4e52dafd058b8"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.238868 19033 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:16.239490 19049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.239639 19033 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:16.239723 19033 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "e6ffc96255614db1bbbc26f7d377f555"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "47102e88e65fa705d2b02a30bdd0f00b"
server_key_iv: "5f632ae8d7f380d168f4e52dafd058b8"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.239779 19033 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:16.247484 19033 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:16.249480 19033 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:16.249612 19033 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:16.249809 19033 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:16.250089 19033 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:16.250123 19033 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.250149 19033 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:16.250173 19033 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.255697 19033 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:33231
I20260808 05:08:16.255735 19212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:33231 every 8 connection(s)
I20260808 05:08:16.256034 19033 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:16.258069 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 19033
I20260808 05:08:16.258183 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:16.258368 13292 external_mini_cluster.cc:1428] Setting key 6d3a04a2cc758d2ff89a001a97fada21
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:16.265702 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.256683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44481 (local address 127.12.251.62:43237)
0808 05:08:16.256737 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:16.256739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:16.256928 (+ 189us) server_negotiation.cc:407] Connection header received
0808 05:08:16.257872 (+ 944us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:16.257873 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:16.257883 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:16.257922 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:16.258709 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.259329 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.260622 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.260871 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.260934 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.263001 (+ 2067us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:16.263003 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:16.263003 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:16.263012 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:16.264428 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.264804 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.264805 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.264805 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.264869 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.265077 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.265078 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.265078 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.265210 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:16.265307 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:16.265527 (+ 220us) server_negotiation.cc:299] Negotiation successful
0808 05:08:16.265609 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:08:16.265766 19216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.256658 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43237 (local address 127.12.251.2:44481)
0808 05:08:16.256811 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:16.256852 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:16.257767 (+ 915us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:16.258012 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:16.258017 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:16.258363 (+ 346us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:16.258613 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:16.258620 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.259419 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.259420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:16.260550 (+ 1130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:16.260553 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.260944 (+ 391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.260945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:16.261052 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.261498 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:16.261506 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:16.262906 (+ 1400us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:16.264519 (+ 1613us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:16.264526 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:16.264527 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:16.264735 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:16.264929 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:16.264929 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:16.264930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:16.265025 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:16.265295 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:16.265299 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:16.265409 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 05:08:16.265492 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:08:16.265609 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":75,"threads_started":1}
I20260808 05:08:16.266321 19214 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43237
I20260808 05:08:16.266407 19214 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:16.266575 19214 heartbeater.cc:511] Master 127.12.251.62:43237 requested a full tablet report, sending...
I20260808 05:08:16.266950 18731 ts_manager.cc:194] Registered new tserver with Master: e6ffc96255614db1bbbc26f7d377f555 (127.12.251.2:33231)
I20260808 05:08:16.267472 18731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:44481
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:16.284564 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43237
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43207
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:16.365293 19222 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:16.365516 19222 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:16.365550 19222 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:16.366735 19222 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:16.366781 19222 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:16.366823 19222 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:16.368328 19222 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43207
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43237
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:16.368568 19222 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:16.368782 19222 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:16.373840 19241 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:16.373834 19237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:16.374046 19222 server_base.cc:1034] running on GCE node
W20260808 05:08:16.373857 19239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:16.374300 19222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:16.374506 19222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:16.375638 19222 hybrid_clock.cc:648] HybridClock initialized: now 1786165696375624 us; error 29 us; skew 500 ppm
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:16.378144 19222 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:16.378556 19222 webserver.cc:460] Webserver started at http://127.12.251.3:37667/ using document root <none> and password file <none>
I20260808 05:08:16.378793 19222 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:16.378842 19222 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:16.378968 19222 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:16.379971 19222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "38eb2fb487e5428d901719db191c58a0"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "9868d6dbaa432f3ada8ae80eee686b9b"
server_key_iv: "b47db95b4ef67c43a21bce84fecddbca"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.380311 19222 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "38eb2fb487e5428d901719db191c58a0"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "9868d6dbaa432f3ada8ae80eee686b9b"
server_key_iv: "b47db95b4ef67c43a21bce84fecddbca"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.381662 19222 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:16.382331 19249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.382484 19222 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:16.382570 19222 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "38eb2fb487e5428d901719db191c58a0"
format_stamp: "Formatted at 2026-08-08 05:08:16 on dist-test-slave-bndk"
server_key: "9868d6dbaa432f3ada8ae80eee686b9b"
server_key_iv: "b47db95b4ef67c43a21bce84fecddbca"
server_key_version: "encryptionkey@0"
I20260808 05:08:16.382629 19222 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:16.394397 19222 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:16.396451 19222 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:16.396590 19222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:16.396787 19222 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:16.397076 19222 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:16.397109 19222 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.397136 19222 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:16.397153 19222 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:16.402727 19222 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:42527
I20260808 05:08:16.402766 19421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:42527 every 8 connection(s)
I20260808 05:08:16.403060 19222 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:16.409184 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 19222
I20260808 05:08:16.409329 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:16.409528 13292 external_mini_cluster.cc:1428] Setting key b242fcf180690510f0a0c224c44241b1
I20260808 05:08:16.411685 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.403710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:58195 (local address 127.12.251.62:43237)
0808 05:08:16.403788 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:16.403791 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:16.403958 (+ 167us) server_negotiation.cc:407] Connection header received
0808 05:08:16.404840 (+ 882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:16.404841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:16.404851 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:16.404890 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:16.405523 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.406016 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.406954 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.407141 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.407186 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.409183 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:16.409186 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:16.409186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:16.409196 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:16.410633 (+ 1437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.410985 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.410986 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.410986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.411036 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.411210 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.411210 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.411210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.411317 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:16.411361 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:16.411562 (+ 201us) server_negotiation.cc:299] Negotiation successful
0808 05:08:16.411622 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:08:16.411859 19424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.403681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43237 (local address 127.12.251.3:58195)
0808 05:08:16.403839 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:16.403874 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:16.404741 (+ 867us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:16.404947 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:16.404951 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:16.405203 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:16.405438 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:16.405443 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.406079 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.406080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:16.406870 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:16.406872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.407194 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.407194 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:16.407293 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.407747 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:16.407756 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:16.409092 (+ 1336us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:16.410696 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:16.410702 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:16.410703 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:16.410916 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:16.411079 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:16.411079 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:16.411080 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:16.411169 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:16.411357 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:16.411360 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:16.411468 (+ 108us) client_negotiation.cc:769] Sending connection context
0808 05:08:16.411541 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 05:08:16.411658 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260808 05:08:16.412339 19422 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43237
I20260808 05:08:16.412422 19422 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:16.412585 19422 heartbeater.cc:511] Master 127.12.251.62:43237 requested a full tablet report, sending...
I20260808 05:08:16.412904 18731 ts_manager.cc:194] Registered new tserver with Master: 38eb2fb487e5428d901719db191c58a0 (127.12.251.3:42527)
I20260808 05:08:16.413267 18731 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:58195
I20260808 05:08:16.421012 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:16.443676 19431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.436779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57612 (local address 127.12.251.1:33013)
0808 05:08:16.436943 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:16.436948 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:16.436959 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:08:16.437000 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:16.437002 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:16.437016 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:16.437085 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:16.437629 (+ 544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.438349 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.439019 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.439318 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.439366 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.441398 (+ 2032us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:16.441410 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:16.441410 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:16.441418 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:16.442713 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.443007 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.443009 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.443009 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.443059 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.443198 (+ 139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.443199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.443199 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.443312 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:16.443416 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:16.443505 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:08:16.443571 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":85,"threads_started":1}
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[18666](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165696, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:16.450728 18824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:16.444895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48370 (local address 127.12.251.62:43237)
0808 05:08:16.444955 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:16.444957 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:16.444966 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:16.445001 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:16.445002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:16.445011 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:16.445053 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:16.445546 (+ 493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.446023 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.446652 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:16.446841 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:16.446894 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:16.448790 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:16.448791 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:16.448792 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:16.448798 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:16.449878 (+ 1080us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.450157 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.450158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.450158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.450202 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:16.450324 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:16.450324 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:16.450324 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:16.450449 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:16.450532 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:16.450597 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 05:08:16.450655 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260808 05:08:16.450948 18731 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48370
I20260808 05:08:16.451284 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 18829
I20260808 05:08:16.466275 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 19033
I20260808 05:08:16.474455 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 19222
I20260808 05:08:16.484419 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 18684
2026-08-08T05:08:16Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (1905 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[19439](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[19439](info): set up 2 sockets
Aug 08 05:08:16 dist-test-slave-bndk krb5kdc[19439](info): commencing operation
krb5kdc: starting...
W20260808 05:08:17.611604 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:17 dist-test-slave-bndk krb5kdc[19439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:17.731930 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:37737
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:37737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:17.813182 19455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:17.813414 19455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:17.813445 19455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:17.814577 19455 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:17.814618 19455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:17.814636 19455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:17.814653 19455 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:17.814673 19455 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:17.816186 19455 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:37737
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:37737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19455
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:17.816430 19455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:17.816643 19455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:17.821206 19467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:17.821206 19462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:17.821259 19464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:17.821411 19455 server_base.cc:1034] running on GCE node
I20260808 05:08:17.821643 19455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:17.821914 19455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:17.823060 19455 hybrid_clock.cc:648] HybridClock initialized: now 1786165697823040 us; error 28 us; skew 500 ppm
Aug 08 05:08:17 dist-test-slave-bndk krb5kdc[19439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165697, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:17.828986 19455 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:17.829339 19455 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:17.829388 19455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:17.829493 19455 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:17.830494 19455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "5875e57ca1f14acdaa1982adb481692b"
format_stamp: "Formatted at 2026-08-08 05:08:17 on dist-test-slave-bndk"
server_key: "684780212278cc9a2820aecdb706ab9f"
server_key_iv: "bb31f3ccaa484e1e05a12c4f81a4ca81"
server_key_version: "encryptionkey@0"
I20260808 05:08:17.830799 19455 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "5875e57ca1f14acdaa1982adb481692b"
format_stamp: "Formatted at 2026-08-08 05:08:17 on dist-test-slave-bndk"
server_key: "684780212278cc9a2820aecdb706ab9f"
server_key_iv: "bb31f3ccaa484e1e05a12c4f81a4ca81"
server_key_version: "encryptionkey@0"
I20260808 05:08:17.832017 19455 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:17.832667 19473 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:17.832835 19455 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:17.832919 19455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "5875e57ca1f14acdaa1982adb481692b"
format_stamp: "Formatted at 2026-08-08 05:08:17 on dist-test-slave-bndk"
server_key: "684780212278cc9a2820aecdb706ab9f"
server_key_iv: "bb31f3ccaa484e1e05a12c4f81a4ca81"
server_key_version: "encryptionkey@0"
I20260808 05:08:17.832978 19455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:17.847942 19455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:17.849668 19455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:17.849778 19455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:17.853657 19455 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:37737
I20260808 05:08:17.853706 19549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:37737 every 8 connection(s)
I20260808 05:08:17.853952 19455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:17.855010 19550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:17.856937 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 19455
I20260808 05:08:17.857036 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:17.857270 13292 external_mini_cluster.cc:1428] Setting key 426daa0b0852e6b0020a84e79d2c81b5
I20260808 05:08:17.857535 19550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b: Bootstrap starting.
I20260808 05:08:17.858294 19550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:17.858595 19550 log.cc:824] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:17.859292 19550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b: No bootstrap required, opened a new log
I20260808 05:08:17.861574 19550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5875e57ca1f14acdaa1982adb481692b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37737 } }
I20260808 05:08:17.861748 19550 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:17.861821 19550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5875e57ca1f14acdaa1982adb481692b, State: Initialized, Role: FOLLOWER
I20260808 05:08:17.861989 19550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5875e57ca1f14acdaa1982adb481692b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37737 } }
I20260808 05:08:17.862118 19550 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:17.862174 19550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:17.862228 19550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:17.862790 19550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5875e57ca1f14acdaa1982adb481692b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37737 } }
I20260808 05:08:17.862923 19550 leader_election.cc:302] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5875e57ca1f14acdaa1982adb481692b; no voters:
I20260808 05:08:17.863090 19550 leader_election.cc:288] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:17.863428 19550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:17.863175 19557 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:17.864406 19557 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [term 1 LEADER]: Becoming Leader. State: Replica: 5875e57ca1f14acdaa1982adb481692b, State: Running, Role: LEADER
I20260808 05:08:17.864555 19557 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5875e57ca1f14acdaa1982adb481692b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37737 } }
Aug 08 05:08:17 dist-test-slave-bndk krb5kdc[19439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165697, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:17.864907 19572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5875e57ca1f14acdaa1982adb481692b. Latest consensus state: current_term: 1 leader_uuid: "5875e57ca1f14acdaa1982adb481692b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5875e57ca1f14acdaa1982adb481692b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37737 } } }
I20260808 05:08:17.864995 19572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:17.865250 19558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5875e57ca1f14acdaa1982adb481692b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5875e57ca1f14acdaa1982adb481692b" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37737 } } }
I20260808 05:08:17.865334 19558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b [sys.catalog]: This master's current role is: LEADER
W20260808 05:08:17.865535 19579 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:08:17.865922 19579 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:08:17.866008 19580 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:17.866156 19580 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:17.868597 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:17.857850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57782 (local address 127.12.251.62:37737)
0808 05:08:17.858189 (+ 339us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:17.858200 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:17.858432 (+ 232us) server_negotiation.cc:407] Connection header received
0808 05:08:17.858917 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:17.858925 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:17.858978 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:17.859105 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:17.859747 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:17.860811 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:17.861897 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:17.862499 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:17.862583 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:17.865669 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:17.865673 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:17.865673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:17.865685 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:17.867244 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:17.867627 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:17.867629 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:17.867629 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:17.867709 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:17.867892 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:17.867893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:17.867893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:17.868101 (+ 208us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:17.868197 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:17.868334 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:08:17.868433 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":243,"threads_started":1}
I20260808 05:08:17.873596 19580 catalog_manager.cc:1347] Generated new cluster ID: 7666c0e73b1b4a07bad770a7726309a4
I20260808 05:08:17.873641 19580 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:17.883976 19580 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:17.884702 19580 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:17.894802 19580 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b: Generated new TSK 0
I20260808 05:08:17.895005 19580 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:17.926044 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37737
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:18.007368 19590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:18.007575 19590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:18.007608 19590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:18.008745 19590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:18.008785 19590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:18.008819 19590 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:18.010345 19590 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:18.010596 19590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:18.010802 19590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:08:18.015645 19590 server_base.cc:1034] running on GCE node
W20260808 05:08:18.015626 19596 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.015626 19600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.015661 19598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.016010 19590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:18.016240 19590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:18.017376 19590 hybrid_clock.cc:648] HybridClock initialized: now 1786165698017364 us; error 25 us; skew 500 ppm
Aug 08 05:08:18 dist-test-slave-bndk krb5kdc[19439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165698, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:18.019789 19590 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:18.020139 19590 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:18.020195 19590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:18.020323 19590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:18.021370 19590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "0d618ebb92694ed2bbecf6a86a526e57"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "8d284a5e18032ff3fb0fd8e76cd87627"
server_key_iv: "42082d6767a181917f37bc1e7fe86067"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.021706 19590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "0d618ebb92694ed2bbecf6a86a526e57"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "8d284a5e18032ff3fb0fd8e76cd87627"
server_key_iv: "42082d6767a181917f37bc1e7fe86067"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.022874 19590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:18.023494 19609 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.023643 19590 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:18.023726 19590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "0d618ebb92694ed2bbecf6a86a526e57"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "8d284a5e18032ff3fb0fd8e76cd87627"
server_key_iv: "42082d6767a181917f37bc1e7fe86067"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.023792 19590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:18.030440 19590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:18.032410 19590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:18.032538 19590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:18.032725 19590 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:18.033011 19590 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:18.033046 19590 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.033073 19590 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:18.033097 19590 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.038697 19590 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:36201
I20260808 05:08:18.038727 19775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:36201 every 8 connection(s)
I20260808 05:08:18.038959 19590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:18.041006 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 19590
I20260808 05:08:18.041100 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:18.041285 13292 external_mini_cluster.cc:1428] Setting key a7026074322905d9d125f2cd46f25c0d
Aug 08 05:08:18 dist-test-slave-bndk krb5kdc[19439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165698, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:18.048312 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.039587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:51463 (local address 127.12.251.62:37737)
0808 05:08:18.039627 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.039629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.039810 (+ 181us) server_negotiation.cc:407] Connection header received
0808 05:08:18.040262 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.040263 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.040275 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.040310 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:18.041207 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.041867 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.042825 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.043045 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.043101 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.045648 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:18.045650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:18.045651 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:18.045658 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:18.046927 (+ 1269us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.047394 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.047394 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.047395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.047441 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.047704 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.047705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.047705 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.047799 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:18.047841 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.048170 (+ 329us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.048246 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:08:18.048563 19779 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.039571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:37737 (local address 127.12.251.1:51463)
0808 05:08:18.039697 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.039732 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.040175 (+ 443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.040369 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.040372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.040607 (+ 235us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:18.041106 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.041113 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.041965 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.041966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.042746 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.042748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.043115 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.043116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.043225 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.043669 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:18.043679 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:18.045555 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:18.047008 (+ 1453us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:18.047017 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:18.047020 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:18.047325 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:18.047496 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:18.047497 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:18.047497 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:18.047643 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:18.047854 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:18.047861 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:18.048027 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.048159 (+ 132us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.048336 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":64,"threads_started":1}
I20260808 05:08:18.049103 19776 heartbeater.cc:347] Connected to a master server at 127.12.251.62:37737
I20260808 05:08:18.049194 19776 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:18.049369 19776 heartbeater.cc:511] Master 127.12.251.62:37737 requested a full tablet report, sending...
I20260808 05:08:18.049876 19497 ts_manager.cc:194] Registered new tserver with Master: 0d618ebb92694ed2bbecf6a86a526e57 (127.12.251.1:36201)
I20260808 05:08:18.050478 19497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:51463
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:18.068023 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37737
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:18.148797 19784 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:18.148988 19784 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:18.149011 19784 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:18.150122 19784 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:18.150156 19784 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:18.150180 19784 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:18.151621 19784 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19784
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:18.151795 19784 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:18.152002 19784 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:18.156656 19791 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.156683 19797 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.156708 19802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.156752 19784 server_base.cc:1034] running on GCE node
I20260808 05:08:18.157023 19784 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:18.157259 19784 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:18.158398 19784 hybrid_clock.cc:648] HybridClock initialized: now 1786165698158385 us; error 30 us; skew 500 ppm
Aug 08 05:08:18 dist-test-slave-bndk krb5kdc[19439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165698, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:18.160754 19784 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:18.161058 19784 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:18.161108 19784 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:18.161268 19784 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:18.162313 19784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "d677ba86cbc44b1eaf34fb02e24e2884"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "0c5e16f3be7561c661aff23c900674eb"
server_key_iv: "a268a21d546006144f06f55f72076e23"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.162637 19784 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "d677ba86cbc44b1eaf34fb02e24e2884"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "0c5e16f3be7561c661aff23c900674eb"
server_key_iv: "a268a21d546006144f06f55f72076e23"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.163879 19784 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:08:18.164582 19811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.164738 19784 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:18.164822 19784 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "d677ba86cbc44b1eaf34fb02e24e2884"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "0c5e16f3be7561c661aff23c900674eb"
server_key_iv: "a268a21d546006144f06f55f72076e23"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.164883 19784 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:18.172917 19784 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:18.174939 19784 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:18.175071 19784 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:18.175261 19784 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:18.175549 19784 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:18.175585 19784 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.175611 19784 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:18.175632 19784 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.181084 19784 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:37807
I20260808 05:08:18.181120 19978 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:37807 every 8 connection(s)
I20260808 05:08:18.181406 19784 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:18.182318 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 19784
I20260808 05:08:18.182425 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:18.182595 13292 external_mini_cluster.cc:1428] Setting key 26743cd9945f4bec4b85d816ba2c5ec1
Aug 08 05:08:18 dist-test-slave-bndk krb5kdc[19439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165698, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:18.190645 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.182087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:49629 (local address 127.12.251.62:37737)
0808 05:08:18.182141 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.182143 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.182350 (+ 207us) server_negotiation.cc:407] Connection header received
0808 05:08:18.182895 (+ 545us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.182897 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.182911 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.182962 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:18.183857 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.184356 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.185680 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.185885 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.185961 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.188143 (+ 2182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:18.188145 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:18.188145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:18.188153 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:18.189402 (+ 1249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.189759 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.189760 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.189760 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.189816 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.190034 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.190035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.190036 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.190145 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:18.190202 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.190459 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.190553 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:08:18.190821 19982 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.182072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:37737 (local address 127.12.251.2:49629)
0808 05:08:18.182221 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.182262 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.182800 (+ 538us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.183038 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.183042 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.183291 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:18.183763 (+ 472us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.183768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.184440 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.184441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.185585 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.185588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.185967 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.185968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.186107 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.186568 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:18.186579 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:18.188058 (+ 1479us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:18.189481 (+ 1423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:18.189487 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:18.189489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:18.189695 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:18.189870 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:18.189870 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:18.189871 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:18.189979 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:18.190199 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:18.190206 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:18.190337 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.190423 (+ 86us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.190569 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260808 05:08:18.191217 19979 heartbeater.cc:347] Connected to a master server at 127.12.251.62:37737
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
I20260808 05:08:18.191313 19979 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:18.191473 19979 heartbeater.cc:511] Master 127.12.251.62:37737 requested a full tablet report, sending...
I20260808 05:08:18.191833 19497 ts_manager.cc:194] Registered new tserver with Master: d677ba86cbc44b1eaf34fb02e24e2884 (127.12.251.2:37807)
I20260808 05:08:18.192207 19497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:49629
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:18.208159 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37737
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33365
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:18.292927 19986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:18.293139 19986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:18.293170 19986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:18.294333 19986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:18.294378 19986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:18.294414 19986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:18.295881 19986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33365
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37737
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:18.296123 19986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:18.296335 19986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:18.301062 19996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.301129 19986 server_base.cc:1034] running on GCE node
W20260808 05:08:18.301059 19992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.301258 19993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.301541 19986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:18.301753 19986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:18.302889 19986 hybrid_clock.cc:648] HybridClock initialized: now 1786165698302876 us; error 30 us; skew 500 ppm
Aug 08 05:08:18 dist-test-slave-bndk krb5kdc[19439](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165698, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:18.305305 19986 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:18.305605 19986 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:18.305660 19986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:18.305788 19986 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:18.306778 19986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "5667d7753af6420e808cb7914ae59196"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "cf0d978714db4788965a515838dad76d"
server_key_iv: "ebebd1fba4a817f4f820e680a424e405"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.307121 19986 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "5667d7753af6420e808cb7914ae59196"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "cf0d978714db4788965a515838dad76d"
server_key_iv: "ebebd1fba4a817f4f820e680a424e405"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.308297 19986 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:18.308915 20005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.309067 19986 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:18.309149 19986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "5667d7753af6420e808cb7914ae59196"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "cf0d978714db4788965a515838dad76d"
server_key_iv: "ebebd1fba4a817f4f820e680a424e405"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.309209 19986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:18.319380 19986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:18.320974 19986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:18.321100 19986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:18.321362 19986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:18.321657 19986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:18.321691 19986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.321718 19986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:18.321744 19986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.327608 19986 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:44515
I20260808 05:08:18.327700 20158 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:44515 every 8 connection(s)
I20260808 05:08:18.327917 19986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:18.332931 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 19986
I20260808 05:08:18.333031 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:18.333256 13292 external_mini_cluster.cc:1428] Setting key e527bdad3ef16da2bc707b7212f0fd47
Aug 08 05:08:18 dist-test-slave-bndk krb5kdc[19439](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165698, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:18.336580 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.328566 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:46523 (local address 127.12.251.62:37737)
0808 05:08:18.328611 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.328613 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.328810 (+ 197us) server_negotiation.cc:407] Connection header received
0808 05:08:18.329324 (+ 514us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.329326 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.329339 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.329385 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:18.330321 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.330834 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.331831 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.332028 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.332083 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.334366 (+ 2283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:18.334367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:18.334368 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:18.334374 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:18.335487 (+ 1113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.335844 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.335845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.335845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.335895 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.336074 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.336075 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.336075 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.336172 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:18.336218 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.336454 (+ 236us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.336516 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:08:18.336772 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.328533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:37737 (local address 127.12.251.3:46523)
0808 05:08:18.328697 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.328729 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.329203 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.329469 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.329473 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.329728 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:18.330217 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.330222 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.330922 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.330923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.331743 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.331745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.332099 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.332100 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.332225 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.332686 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:18.332694 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:18.334293 (+ 1599us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:18.335554 (+ 1261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:18.335560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:18.335562 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:18.335796 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:18.335939 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:18.335940 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:18.335940 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:18.336033 (+ 93us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:18.336212 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:18.336215 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:18.336350 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.336433 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.336563 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":86,"threads_started":1}
I20260808 05:08:18.337147 20160 heartbeater.cc:347] Connected to a master server at 127.12.251.62:37737
I20260808 05:08:18.337260 20160 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:18.337410 20160 heartbeater.cc:511] Master 127.12.251.62:37737 requested a full tablet report, sending...
I20260808 05:08:18.337751 19497 ts_manager.cc:194] Registered new tserver with Master: 5667d7753af6420e808cb7914ae59196 (127.12.251.3:44515)
I20260808 05:08:18.338106 19497 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:46523
I20260808 05:08:18.344867 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:08:18.351588 19554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.346202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57790 (local address 127.12.251.62:37737)
0808 05:08:18.346251 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.346253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.346330 (+ 77us) server_negotiation.cc:407] Connection header received
0808 05:08:18.346373 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.346374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.346382 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.346427 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:18.346927 (+ 500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.347403 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.348056 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.348223 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.348264 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.349311 (+ 1047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:18.349312 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:18.349312 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:18.349318 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:18.350520 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.350848 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.350849 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.350849 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.350901 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:18.351064 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:18.351064 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:18.351065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:18.351207 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:18.351312 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.351419 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.351499 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:08:18.352912 19497 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:18.354624 19497 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:18.360522 20174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.356662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:44515 (local address 127.0.0.1:33148)
0808 05:08:18.357039 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.357048 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.357083 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.357260 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.357264 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.357267 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:18.357332 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.357334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.358290 (+ 956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.358291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.359472 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.359474 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.360236 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.360237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.360312 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.360326 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.360386 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.360450 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"mutex_wait_us":2,"thread_start_us":75,"threads_started":1}
I20260808 05:08:18.360533 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.356902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33148 (local address 127.12.251.3:44515)
0808 05:08:18.357082 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.357087 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.357116 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:08:18.357148 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.357149 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.357162 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.357244 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:18.357496 (+ 252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.358198 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.359561 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.360163 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.360223 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.360285 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.360411 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.360451 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
I20260808 05:08:18.360980 20170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.356662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:37807 (local address 127.0.0.1:55772)
0808 05:08:18.356939 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.356959 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.356999 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.357609 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.357610 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.357613 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:18.357645 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.357647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.358846 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.358847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.359781 (+ 934us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.359784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.360707 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.360708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.360789 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.360795 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.360847 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.360889 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"mutex_wait_us":5,"thread_start_us":59,"threads_started":1}
I20260808 05:08:18.360993 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.356777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43114 (local address 127.12.251.1:36201)
0808 05:08:18.357106 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.357111 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.357120 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:18.357157 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.357159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.357173 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.357302 (+ 129us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:18.357518 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.358607 (+ 1089us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.359821 (+ 1214us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.360542 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.360611 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.360669 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.360869 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.360913 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":294,"thread_start_us":83,"threads_started":1}
I20260808 05:08:18.360985 20176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.356657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36201 (local address 127.0.0.1:43114)
0808 05:08:18.356841 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.356881 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.356943 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.357361 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.357362 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.357364 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:18.357418 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.357419 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.358707 (+ 1288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.358708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.359744 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.359747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.360706 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.360707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.360789 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.360795 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.360847 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.360889 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":45,"thread_start_us":67,"threads_started":1}
I20260808 05:08:18.361204 20179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.356920 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55772 (local address 127.12.251.2:37807)
0808 05:08:18.357384 (+ 464us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.357388 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.357398 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:18.357435 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.357437 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.357452 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.357521 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:18.357718 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.358761 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.359872 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.360550 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.360611 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.360669 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.361090 (+ 421us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.361132 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":427,"thread_start_us":66,"threads_started":1}
I20260808 05:08:18.361395 20072 tablet_service.cc:1467] Processing CreateTablet for tablet 3670a8319c3248ed981c8643423896d0 (DEFAULT_TABLE table=test-table [id=2e28a819113d4a5291f46fed0a72e2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:18.361776 20072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3670a8319c3248ed981c8643423896d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:18.361892 19883 tablet_service.cc:1467] Processing CreateTablet for tablet 3670a8319c3248ed981c8643423896d0 (DEFAULT_TABLE table=test-table [id=2e28a819113d4a5291f46fed0a72e2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:18.362157 19883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3670a8319c3248ed981c8643423896d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:18.364403 20181 tablet_bootstrap.cc:492] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Bootstrap starting.
I20260808 05:08:18.365065 20182 tablet_bootstrap.cc:492] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Bootstrap starting.
I20260808 05:08:18.365262 20181 tablet_bootstrap.cc:654] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:18.365190 19680 tablet_service.cc:1467] Processing CreateTablet for tablet 3670a8319c3248ed981c8643423896d0 (DEFAULT_TABLE table=test-table [id=2e28a819113d4a5291f46fed0a72e2cd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:18.365520 19680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3670a8319c3248ed981c8643423896d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:18.365773 20182 tablet_bootstrap.cc:654] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:18.365890 20181 log.cc:824] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:18.366286 20182 log.cc:824] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:18.366663 20181 tablet_bootstrap.cc:492] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: No bootstrap required, opened a new log
I20260808 05:08:18.366706 20181 ts_tablet_manager.cc:1397] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:08:18.367069 20182 tablet_bootstrap.cc:492] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: No bootstrap required, opened a new log
I20260808 05:08:18.367125 20182 ts_tablet_manager.cc:1397] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:18.368211 20188 tablet_bootstrap.cc:492] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57: Bootstrap starting.
I20260808 05:08:18.368844 20188 tablet_bootstrap.cc:654] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:18.368788 20181 raft_consensus.cc:348] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.368995 20181 raft_consensus.cc:374] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:18.369066 20181 raft_consensus.cc:729] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5667d7753af6420e808cb7914ae59196, State: Initialized, Role: FOLLOWER
I20260808 05:08:18.369210 20181 consensus_queue.cc:260] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.369189 20182 raft_consensus.cc:348] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.369388 20182 raft_consensus.cc:374] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:18.369441 20182 raft_consensus.cc:729] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d677ba86cbc44b1eaf34fb02e24e2884, State: Initialized, Role: FOLLOWER
I20260808 05:08:18.369429 20188 log.cc:824] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:18.369524 20181 ts_tablet_manager.cc:1428] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:08:18.369557 20182 consensus_queue.cc:260] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.369716 20160 heartbeater.cc:503] Master 127.12.251.62:37737 was elected leader, sending a full tablet report...
I20260808 05:08:18.369889 19979 heartbeater.cc:503] Master 127.12.251.62:37737 was elected leader, sending a full tablet report...
I20260808 05:08:18.369879 20182 ts_tablet_manager.cc:1428] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:08:18.370146 20188 tablet_bootstrap.cc:492] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57: No bootstrap required, opened a new log
I20260808 05:08:18.370338 20188 ts_tablet_manager.cc:1397] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:08:18.371870 20188 raft_consensus.cc:348] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.372002 20188 raft_consensus.cc:374] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:18.372035 20188 raft_consensus.cc:729] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d618ebb92694ed2bbecf6a86a526e57, State: Initialized, Role: FOLLOWER
I20260808 05:08:18.372144 20188 consensus_queue.cc:260] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.372382 20188 ts_tablet_manager.cc:1428] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:08:18.372416 19776 heartbeater.cc:503] Master 127.12.251.62:37737 was elected leader, sending a full tablet report...
W20260808 05:08:18.431910 19981 tablet.cc:2369] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:18.458663 20189 raft_consensus.cc:482] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:18.458811 20189 raft_consensus.cc:504] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.459203 20189 leader_election.cc:288] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d618ebb92694ed2bbecf6a86a526e57 (127.12.251.1:36201), d677ba86cbc44b1eaf34fb02e24e2884 (127.12.251.2:37807)
I20260808 05:08:18.462107 20177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.459482 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:51121 (local address 127.12.251.1:36201)
0808 05:08:18.459525 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.459527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.459702 (+ 175us) server_negotiation.cc:407] Connection header received
0808 05:08:18.459735 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.459736 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.459747 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.459815 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:18.460004 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.460492 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.461427 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.461780 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.461841 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.461850 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.461996 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.462034 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:18.462117 20162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.459380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:37807 (local address 127.12.251.3:53679)
0808 05:08:18.459446 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.459459 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.459530 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.459724 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.459725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.459728 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:18.459809 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.459810 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.460469 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.460470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.461315 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.461325 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.461876 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.461877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.461948 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.461951 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.461998 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.462035 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:08:18.462114 20179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.459460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:53679 (local address 127.12.251.2:37807)
0808 05:08:18.459507 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.459509 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.459520 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:08:18.459612 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.459613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.459624 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.459674 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:18.459885 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.460390 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.461408 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.461799 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.461865 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.461873 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.462013 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.462049 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:18.462137 20195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.459381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36201 (local address 127.12.251.3:51121)
0808 05:08:18.459598 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.459608 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.459673 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.459853 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.459854 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.459856 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:18.459925 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.459927 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.460567 (+ 640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.460568 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.461348 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:18.461350 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.461851 (+ 501us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.461852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:18.461919 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.461922 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.461981 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.462020 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"mutex_wait_us":22,"thread_start_us":133,"threads_started":1}
I20260808 05:08:18.462531 19705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3670a8319c3248ed981c8643423896d0" candidate_uuid: "5667d7753af6420e808cb7914ae59196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d618ebb92694ed2bbecf6a86a526e57" is_pre_election: true
I20260808 05:08:18.462519 19909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3670a8319c3248ed981c8643423896d0" candidate_uuid: "5667d7753af6420e808cb7914ae59196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" is_pre_election: true
I20260808 05:08:18.462670 19705 raft_consensus.cc:2454] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5667d7753af6420e808cb7914ae59196 in term 0.
I20260808 05:08:18.462667 19909 raft_consensus.cc:2454] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5667d7753af6420e808cb7914ae59196 in term 0.
I20260808 05:08:18.462877 20007 leader_election.cc:302] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5667d7753af6420e808cb7914ae59196, d677ba86cbc44b1eaf34fb02e24e2884; no voters:
I20260808 05:08:18.463004 20189 raft_consensus.cc:2781] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:18.463084 20189 raft_consensus.cc:482] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:18.463116 20189 raft_consensus.cc:3037] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:18.463850 20189 raft_consensus.cc:504] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.463979 20189 leader_election.cc:288] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [CANDIDATE]: Term 1 election: Requested vote from peers 0d618ebb92694ed2bbecf6a86a526e57 (127.12.251.1:36201), d677ba86cbc44b1eaf34fb02e24e2884 (127.12.251.2:37807)
I20260808 05:08:18.464108 19909 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3670a8319c3248ed981c8643423896d0" candidate_uuid: "5667d7753af6420e808cb7914ae59196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d677ba86cbc44b1eaf34fb02e24e2884"
I20260808 05:08:18.464114 19705 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3670a8319c3248ed981c8643423896d0" candidate_uuid: "5667d7753af6420e808cb7914ae59196" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d618ebb92694ed2bbecf6a86a526e57"
I20260808 05:08:18.464190 19909 raft_consensus.cc:3037] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:18.464205 19705 raft_consensus.cc:3037] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:18.464870 19909 raft_consensus.cc:2454] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5667d7753af6420e808cb7914ae59196 in term 1.
I20260808 05:08:18.464887 19705 raft_consensus.cc:2454] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5667d7753af6420e808cb7914ae59196 in term 1.
I20260808 05:08:18.465050 20007 leader_election.cc:302] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5667d7753af6420e808cb7914ae59196, d677ba86cbc44b1eaf34fb02e24e2884; no voters:
I20260808 05:08:18.465168 20189 raft_consensus.cc:2781] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:18.465342 20189 raft_consensus.cc:686] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 1 LEADER]: Becoming Leader. State: Replica: 5667d7753af6420e808cb7914ae59196, State: Running, Role: LEADER
I20260808 05:08:18.465430 20189 consensus_queue.cc:237] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } }
I20260808 05:08:18.466212 19497 catalog_manager.cc:5495] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5667d7753af6420e808cb7914ae59196 (127.12.251.3). New cstate: current_term: 1 leader_uuid: "5667d7753af6420e808cb7914ae59196" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5667d7753af6420e808cb7914ae59196" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44515 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:18.474354 20178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.472315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33152 (local address 127.12.251.3:44515)
0808 05:08:18.472353 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.472354 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.472362 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:18.472435 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.472436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.472450 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.472510 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:18.472666 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.473087 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.473786 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:18.473964 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:18.474008 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:18.474111 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:18.474197 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:18.474248 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.474275 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.474289 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:18.475914 19909 raft_consensus.cc:1261] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 1 FOLLOWER]: Refusing update from remote peer 5667d7753af6420e808cb7914ae59196: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:18.475914 19705 raft_consensus.cc:1261] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 1 FOLLOWER]: Refusing update from remote peer 5667d7753af6420e808cb7914ae59196: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:18.476219 20197 consensus_queue.cc:1035] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d618ebb92694ed2bbecf6a86a526e57" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:18.476336 20189 consensus_queue.cc:1035] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d677ba86cbc44b1eaf34fb02e24e2884" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 37807 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:18.478564 20202 mvcc.cc:205] Tried to move back new op lower bound from 7316134700955201536 to 7316134700915044352. Current Snapshot: MvccSnapshot[applied={T|T < 7316134700955201536}]
I20260808 05:08:18.480576 19497 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:18.480656 19497 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57790:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:18.481341 19497 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5875e57ca1f14acdaa1982adb481692b: Sending DeleteTablet for 3 replicas of tablet 3670a8319c3248ed981c8643423896d0
I20260808 05:08:18.481662 20072 tablet_service.cc:1514] Processing DeleteTablet for tablet 3670a8319c3248ed981c8643423896d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:18 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:33148
I20260808 05:08:18.481818 19680 tablet_service.cc:1514] Processing DeleteTablet for tablet 3670a8319c3248ed981c8643423896d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:18 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:43114
I20260808 05:08:18.481894 19883 tablet_service.cc:1514] Processing DeleteTablet for tablet 3670a8319c3248ed981c8643423896d0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:18 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:55772
I20260808 05:08:18.482059 20217 tablet_replica.cc:330] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57: stopping tablet replica
I20260808 05:08:18.482146 20218 tablet_replica.cc:330] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: stopping tablet replica
I20260808 05:08:18.482210 20217 raft_consensus.cc:2229] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:18.482350 20217 raft_consensus.cc:2258] T 3670a8319c3248ed981c8643423896d0 P 0d618ebb92694ed2bbecf6a86a526e57 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:18.482349 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 19590
I20260808 05:08:18.484925 20218 raft_consensus.cc:2229] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:18.485072 20218 raft_consensus.cc:2258] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:18.486828 20218 ts_tablet_manager.cc:1905] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:18.488642 20218 ts_tablet_manager.cc:1918] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:18.488720 20218 log.cc:1196] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/3670a8319c3248ed981c8643423896d0
I20260808 05:08:18.489018 20218 ts_tablet_manager.cc:1939] T 3670a8319c3248ed981c8643423896d0 P d677ba86cbc44b1eaf34fb02e24e2884: Deleting consensus metadata
I20260808 05:08:18.489486 19476 catalog_manager.cc:4841] TS d677ba86cbc44b1eaf34fb02e24e2884 (127.12.251.2:37807): tablet 3670a8319c3248ed981c8643423896d0 (table test-table [id=2e28a819113d4a5291f46fed0a72e2cd]) successfully deleted
W20260808 05:08:18.492697 19475 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:36201 (error 108)
I20260808 05:08:18.492956 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 19784
I20260808 05:08:18.493072 20215 tablet_replica.cc:330] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: stopping tablet replica
I20260808 05:08:18.493185 20215 raft_consensus.cc:2229] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:18.493304 20215 raft_consensus.cc:2258] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:18.493505 20176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.493072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36201 (local address 127.0.0.1:43118)
0808 05:08:18.493410 (+ 338us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.493467 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":318}
W20260808 05:08:18.494771 19475 catalog_manager.cc:4584] TS 0d618ebb92694ed2bbecf6a86a526e57 (127.12.251.1:36201): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3670a8319c3248ed981c8643423896d0: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36201: connect: Connection refused (error 111)
I20260808 05:08:18.494910 20215 ts_tablet_manager.cc:1905] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:18.496483 20215 ts_tablet_manager.cc:1918] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:18.496546 20215 log.cc:1196] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/3670a8319c3248ed981c8643423896d0
I20260808 05:08:18.496800 20215 ts_tablet_manager.cc:1939] T 3670a8319c3248ed981c8643423896d0 P 5667d7753af6420e808cb7914ae59196: Deleting consensus metadata
I20260808 05:08:18.498203 19477 catalog_manager.cc:4841] TS 5667d7753af6420e808cb7914ae59196 (127.12.251.3:44515): tablet 3670a8319c3248ed981c8643423896d0 (table test-table [id=2e28a819113d4a5291f46fed0a72e2cd]) successfully deleted
I20260808 05:08:18.499169 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 19986
I20260808 05:08:18.506237 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 19455
2026-08-08T05:08:18Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2019 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-08T05:08:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:18Z Disabled control of system clock
I20260808 05:08:18.539383 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:37473
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:37473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:08:18.619920 20228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:18.620108 20228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:18.620126 20228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:18.621256 20228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:18.621294 20228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:18.621305 20228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:18.621318 20228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:18.621342 20228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:18.622671 20228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:37473
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:37473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20228
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:18.622895 20228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:18.623169 20228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:18.627669 20239 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.627769 20237 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.627897 20236 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.627898 20228 server_base.cc:1034] running on GCE node
I20260808 05:08:18.628155 20228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:18.628448 20228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:18.629585 20228 hybrid_clock.cc:648] HybridClock initialized: now 1786165698629560 us; error 37 us; skew 500 ppm
I20260808 05:08:18.631385 20228 webserver.cc:460] Webserver started at http://127.12.251.62:37605/ using document root <none> and password file <none>
I20260808 05:08:18.631609 20228 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:18.631655 20228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:18.631784 20228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:18.632798 20228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "942ad794d140486a95d1a006f3120164"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "c53f1642022f42010ecd9a1a420b8524"
server_key_iv: "123ab413c23d2da15049068bdd2a8e98"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.633131 20228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "942ad794d140486a95d1a006f3120164"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "c53f1642022f42010ecd9a1a420b8524"
server_key_iv: "123ab413c23d2da15049068bdd2a8e98"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.634333 20228 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:18.634984 20248 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.635128 20228 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:18.635211 20228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "942ad794d140486a95d1a006f3120164"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "c53f1642022f42010ecd9a1a420b8524"
server_key_iv: "123ab413c23d2da15049068bdd2a8e98"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.635273 20228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:18.638442 20228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:18.638679 20228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:18.638796 20228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:18.642338 20228 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:37473
I20260808 05:08:18.642412 20320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:37473 every 8 connection(s)
I20260808 05:08:18.642664 20228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:18.643254 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 20228
I20260808 05:08:18.643344 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:18.643375 20321 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:18.643517 13292 external_mini_cluster.cc:1428] Setting key ef153c682805682b24e7b0306821af0e
I20260808 05:08:18.646155 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.644270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40208 (local address 127.12.251.62:37473)
0808 05:08:18.644446 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.644452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.644475 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:08:18.644887 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.644894 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.644932 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.645056 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:18.645748 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:18.645752 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:18.645752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:18.645756 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:18.645804 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:18.645816 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:18.645874 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.645959 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.646016 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260808 05:08:18.646433 20321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164: Bootstrap starting.
I20260808 05:08:18.647068 20321 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:18.647317 20321 log.cc:824] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:18.647958 20321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164: No bootstrap required, opened a new log
I20260808 05:08:18.649336 20321 raft_consensus.cc:348] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942ad794d140486a95d1a006f3120164" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37473 } }
I20260808 05:08:18.649493 20321 raft_consensus.cc:374] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:18.649540 20321 raft_consensus.cc:729] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 942ad794d140486a95d1a006f3120164, State: Initialized, Role: FOLLOWER
I20260808 05:08:18.649653 20321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942ad794d140486a95d1a006f3120164" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37473 } }
I20260808 05:08:18.649732 20321 raft_consensus.cc:388] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:18.649763 20321 raft_consensus.cc:482] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:18.649811 20321 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:18.650647 20321 raft_consensus.cc:504] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942ad794d140486a95d1a006f3120164" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37473 } }
I20260808 05:08:18.650738 20321 leader_election.cc:302] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 942ad794d140486a95d1a006f3120164; no voters:
I20260808 05:08:18.650887 20321 leader_election.cc:288] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:18.650929 20329 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:18.651074 20329 raft_consensus.cc:686] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [term 1 LEADER]: Becoming Leader. State: Replica: 942ad794d140486a95d1a006f3120164, State: Running, Role: LEADER
I20260808 05:08:18.651121 20321 sys_catalog.cc:564] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:18.651165 20329 consensus_queue.cc:237] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942ad794d140486a95d1a006f3120164" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37473 } }
I20260808 05:08:18.651516 20330 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "942ad794d140486a95d1a006f3120164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942ad794d140486a95d1a006f3120164" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37473 } } }
I20260808 05:08:18.651624 20330 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:18.651521 20331 sys_catalog.cc:455] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 942ad794d140486a95d1a006f3120164. Latest consensus state: current_term: 1 leader_uuid: "942ad794d140486a95d1a006f3120164" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "942ad794d140486a95d1a006f3120164" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37473 } } }
I20260808 05:08:18.651688 20331 sys_catalog.cc:458] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:18.651865 20342 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:18.652434 20342 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:18.653934 20342 catalog_manager.cc:1347] Generated new cluster ID: 2d304cc2c2e04b69a0f504ec10bfe5fb
I20260808 05:08:18.653980 20342 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:18.661752 20342 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:18.661887 20342 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:18.663749 20342 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164: Generated new TSK 0
I20260808 05:08:18.663894 20342 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:08:18.667557 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37473
--builtin_ntp_servers=127.12.251.20:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:08:18.752039 20359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:18.752233 20359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:18.752262 20359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:18.753481 20359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:18.753523 20359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:18.753557 20359 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:18.754853 20359 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:18.755080 20359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:18.755342 20359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:18.760862 20368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.760931 20359 server_base.cc:1034] running on GCE node
W20260808 05:08:18.760859 20373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.761075 20367 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.761330 20359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:18.761547 20359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:18.762696 20359 hybrid_clock.cc:648] HybridClock initialized: now 1786165698762685 us; error 28 us; skew 500 ppm
I20260808 05:08:18.763877 20359 webserver.cc:460] Webserver started at http://127.12.251.1:46139/ using document root <none> and password file <none>
I20260808 05:08:18.764091 20359 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:18.764134 20359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:18.764254 20359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:18.765293 20359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "639c280e2e0c4de6917628367bb6f699"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "748a964e3efe320b6a6d49d9c23d289d"
server_key_iv: "f0c535a55c36cee5e69f06572ea08283"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.765614 20359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "639c280e2e0c4de6917628367bb6f699"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "748a964e3efe320b6a6d49d9c23d289d"
server_key_iv: "f0c535a55c36cee5e69f06572ea08283"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.766824 20359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:18.767540 20380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.767699 20359 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.767782 20359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "639c280e2e0c4de6917628367bb6f699"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "748a964e3efe320b6a6d49d9c23d289d"
server_key_iv: "f0c535a55c36cee5e69f06572ea08283"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.767843 20359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:18.771030 20359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:18.771267 20359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:18.771397 20359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:18.771602 20359 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:18.771890 20359 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:18.771921 20359 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.771956 20359 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:18.771981 20359 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.777622 20359 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:43217
I20260808 05:08:18.777663 20538 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:43217 every 8 connection(s)
I20260808 05:08:18.777951 20359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:18.780591 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.778581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:39037 (local address 127.12.251.62:37473)
0808 05:08:18.778630 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.778632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.778812 (+ 180us) server_negotiation.cc:407] Connection header received
0808 05:08:18.779275 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.779276 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.779282 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.779326 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:18.780350 (+ 1024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:18.780352 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:18.780353 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:18.780357 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:18.780373 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:18.780377 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:18.780426 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.780506 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.780521 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:08:18.780757 20542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.778547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:37473 (local address 127.12.251.1:39037)
0808 05:08:18.778704 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.778735 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.779181 (+ 446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.779402 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.779406 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.779416 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:18.780214 (+ 798us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:18.780214 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:18.780240 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:18.780267 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:18.780432 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:18.780437 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:18.780440 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.780507 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.780568 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
I20260808 05:08:18.781172 20540 heartbeater.cc:347] Connected to a master server at 127.12.251.62:37473
I20260808 05:08:18.781271 20540 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:18.781411 20540 heartbeater.cc:511] Master 127.12.251.62:37473 requested a full tablet report, sending...
I20260808 05:08:18.781873 20274 ts_manager.cc:194] Registered new tserver with Master: 639c280e2e0c4de6917628367bb6f699 (127.12.251.1:43217)
I20260808 05:08:18.786152 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 20359
I20260808 05:08:18.786250 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:18.786419 13292 external_mini_cluster.cc:1428] Setting key 5ea0bc6414d41821404763f3e81702b7
I20260808 05:08:18.787209 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37473
--builtin_ntp_servers=127.12.251.20:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:08:18.868357 20543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:18.868557 20543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:18.868588 20543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:18.869761 20543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:18.869800 20543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:18.869834 20543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:18.871165 20543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:18.871405 20543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:18.871701 20543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:18.876302 20555 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.876307 20553 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:18.876287 20551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:18.876556 20543 server_base.cc:1034] running on GCE node
I20260808 05:08:18.876765 20543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:18.876972 20543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:18.878110 20543 hybrid_clock.cc:648] HybridClock initialized: now 1786165698878076 us; error 50 us; skew 500 ppm
I20260808 05:08:18.879249 20543 webserver.cc:460] Webserver started at http://127.12.251.2:42897/ using document root <none> and password file <none>
I20260808 05:08:18.879491 20543 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:18.879542 20543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:18.879670 20543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:18.880693 20543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "e3cb746acd8d41d39f9091894563e169"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "105038a2d216ae4e3f68d0d8b91f7b6e"
server_key_iv: "31980488763c61ac210e993480a1b9fb"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.881024 20543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "e3cb746acd8d41d39f9091894563e169"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "105038a2d216ae4e3f68d0d8b91f7b6e"
server_key_iv: "31980488763c61ac210e993480a1b9fb"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.882232 20543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:18.882850 20566 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.883008 20543 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:18.883081 20543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "e3cb746acd8d41d39f9091894563e169"
format_stamp: "Formatted at 2026-08-08 05:08:18 on dist-test-slave-bndk"
server_key: "105038a2d216ae4e3f68d0d8b91f7b6e"
server_key_iv: "31980488763c61ac210e993480a1b9fb"
server_key_version: "encryptionkey@0"
I20260808 05:08:18.883148 20543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:18.886386 20543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:18.886634 20543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:18.886749 20543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:18.886938 20543 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:18.887250 20543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:18.887297 20543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.887324 20543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:18.887341 20543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:18.894454 20543 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:44899
I20260808 05:08:18.894522 20730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:44899 every 8 connection(s)
I20260808 05:08:18.894881 20543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:18.899993 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.897340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:35977 (local address 127.12.251.62:37473)
0808 05:08:18.897395 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:18.897397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:18.897658 (+ 261us) server_negotiation.cc:407] Connection header received
0808 05:08:18.898315 (+ 657us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:18.898317 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:18.898325 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:18.898392 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:18.899722 (+ 1330us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:18.899724 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:18.899725 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:18.899729 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:18.899749 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:18.899754 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:18.899811 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:18.899901 (+ 90us) server_negotiation.cc:299] Negotiation successful
0808 05:08:18.899917 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:08:18.900192 20734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:18.897354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:37473 (local address 127.12.251.2:35977)
0808 05:08:18.897532 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:18.897572 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:18.898194 (+ 622us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:18.898490 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:18.898495 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:18.898505 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:18.899551 (+ 1046us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:18.899552 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:18.899593 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:18.899630 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:18.899822 (+ 192us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:18.899830 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:18.899833 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:18.899911 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:08:18.899974 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":66,"threads_started":1}
I20260808 05:08:18.900636 20731 heartbeater.cc:347] Connected to a master server at 127.12.251.62:37473
I20260808 05:08:18.900745 20731 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:18.900904 20731 heartbeater.cc:511] Master 127.12.251.62:37473 requested a full tablet report, sending...
I20260808 05:08:18.901315 20274 ts_manager.cc:194] Registered new tserver with Master: e3cb746acd8d41d39f9091894563e169 (127.12.251.2:44899)
I20260808 05:08:18.902218 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 20543
I20260808 05:08:18.902325 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:18.902484 13292 external_mini_cluster.cc:1428] Setting key 3a7a1288f83c84641542faf293355144
I20260808 05:08:18.903283 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37473
--builtin_ntp_servers=127.12.251.20:46555
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260808 05:08:18.993362 20735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:18.993561 20735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:18.993580 20735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:18.994661 20735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:18.994692 20735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:18.994715 20735 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:18.995991 20735 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46555
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:37473
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20735
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:18.996181 20735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:18.996420 20735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:19.001147 20745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:19.001206 20743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.001209 20735 server_base.cc:1034] running on GCE node
W20260808 05:08:19.001154 20749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.001556 20735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:19.001796 20735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:19.002924 20735 hybrid_clock.cc:648] HybridClock initialized: now 1786165699002913 us; error 31 us; skew 500 ppm
I20260808 05:08:19.004109 20735 webserver.cc:460] Webserver started at http://127.12.251.3:34761/ using document root <none> and password file <none>
I20260808 05:08:19.004334 20735 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:19.004381 20735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:19.004489 20735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:19.005545 20735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "997bb360ef004679a0a6e4015093749b"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "c840c835746c24ad9c46fb849c8f77ca"
server_key_iv: "144204bd8de2ee821399a0635442f11e"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.005858 20735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "997bb360ef004679a0a6e4015093749b"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "c840c835746c24ad9c46fb849c8f77ca"
server_key_iv: "144204bd8de2ee821399a0635442f11e"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.007040 20735 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:19.007690 20758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:19.007849 20735 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:19.007923 20735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "997bb360ef004679a0a6e4015093749b"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "c840c835746c24ad9c46fb849c8f77ca"
server_key_iv: "144204bd8de2ee821399a0635442f11e"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.007987 20735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:19.011233 20735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:19.011482 20735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:19.011596 20735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:19.011778 20735 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:19.012048 20735 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:19.012079 20735 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:19.012106 20735 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:19.012130 20735 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:19.017434 20735 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:43379
I20260808 05:08:19.017469 20918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:43379 every 8 connection(s)
I20260808 05:08:19.017743 20735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:19.020448 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.018378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:39109 (local address 127.12.251.62:37473)
0808 05:08:19.018442 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.018444 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.018619 (+ 175us) server_negotiation.cc:407] Connection header received
0808 05:08:19.019065 (+ 446us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.019067 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.019073 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.019124 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.020167 (+ 1043us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.020168 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.020169 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.020173 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.020190 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.020194 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.020265 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.020341 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.020355 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:08:19.020599 20923 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.018322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:37473 (local address 127.12.251.3:39109)
0808 05:08:19.018516 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.018546 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.018973 (+ 427us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.019189 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.019192 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.019200 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:19.020027 (+ 827us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:19.020027 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:19.020054 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:19.020081 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:19.020269 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:19.020275 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:19.020279 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:19.020344 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:08:19.020403 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":90,"threads_started":1}
I20260808 05:08:19.020790 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 20735
I20260808 05:08:19.020879 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:19.021046 13292 external_mini_cluster.cc:1428] Setting key e26ae21f5e460e87b66cd1aeb6a55de0
I20260808 05:08:19.021039 20921 heartbeater.cc:347] Connected to a master server at 127.12.251.62:37473
I20260808 05:08:19.021124 20921 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:19.021287 20921 heartbeater.cc:511] Master 127.12.251.62:37473 requested a full tablet report, sending...
I20260808 05:08:19.021637 20274 ts_manager.cc:194] Registered new tserver with Master: 997bb360ef004679a0a6e4015093749b (127.12.251.3:43379)
I20260808 05:08:19.021948 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:08:19.023974 20327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.023153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40222 (local address 127.12.251.62:37473)
0808 05:08:19.023199 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.023201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.023278 (+ 77us) server_negotiation.cc:407] Connection header received
0808 05:08:19.023331 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.023331 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.023335 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.023381 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.023846 (+ 465us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.023847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.023847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.023849 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.023857 (+ 8us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.023859 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.023890 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.023921 (+ 31us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.023930 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:08:19.025478 20272 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40222:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:19.026989 20272 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:19.030761 20932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.029029 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:44899 (local address 127.0.0.1:58882)
0808 05:08:19.029275 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.029283 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.029316 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.029534 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.029540 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.029546 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:19.030261 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:19.030262 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:19.030274 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:19.030292 (+ 18us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:19.030594 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:19.030601 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:19.030604 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:19.030664 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:08:19.030677 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":233,"thread_start_us":65,"threads_started":1}
I20260808 05:08:19.030761 20939 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.028839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:43379 (local address 127.0.0.1:49852)
0808 05:08:19.029137 (+ 298us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.029147 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.029188 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.029662 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.029663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.029666 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:19.030369 (+ 703us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:19.030369 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:19.030376 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:19.030390 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:19.030604 (+ 214us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:19.030604 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:19.030605 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:19.030667 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:08:19.030679 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":2,"thread_start_us":49,"threads_started":1}
I20260808 05:08:19.030884 20930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.028839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43217 (local address 127.0.0.1:56382)
0808 05:08:19.029088 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.029127 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.029184 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.029798 (+ 614us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.029799 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.029800 (+ 1us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:19.030514 (+ 714us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:19.030514 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:19.030520 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:19.030530 (+ 10us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:19.030762 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:19.030763 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:19.030764 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:19.030804 (+ 40us) client_negotiation.cc:240] Negotiation successful
0808 05:08:19.030817 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":71,"threads_started":1}
I20260808 05:08:19.031152 20938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.028922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56382 (local address 127.12.251.1:43217)
0808 05:08:19.029438 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.029443 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.029452 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:19.029478 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.029480 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.029488 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.029537 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.030605 (+ 1068us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.030616 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.030617 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.030621 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.030653 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.030682 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.030736 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.031056 (+ 320us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.031072 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":92,"threads_started":1}
I20260808 05:08:19.031224 20934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.028931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49852 (local address 127.12.251.3:43379)
0808 05:08:19.029094 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.029099 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.029256 (+ 157us) server_negotiation.cc:407] Connection header received
0808 05:08:19.029281 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.029284 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.029295 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.029343 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.030479 (+ 1136us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.030486 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.030487 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.030491 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.030523 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.030542 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.030601 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.031141 (+ 540us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.031155 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":79,"threads_started":1}
I20260808 05:08:19.030788 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.029246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58882 (local address 127.12.251.2:44899)
0808 05:08:19.029400 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.029404 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.029415 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:08:19.029441 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.029442 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.029449 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.029519 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.030367 (+ 848us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.030377 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.030377 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.030382 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.030415 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.030444 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.030500 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.030685 (+ 185us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.030702 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":83,"threads_started":1}
I20260808 05:08:19.031878 20450 tablet_service.cc:1467] Processing CreateTablet for tablet 83ca7ec151a44da9b5a33ede047f8a3c (DEFAULT_TABLE table=test-table [id=bf445ce1c10f40f18cdf7dc0f3c457d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:19.031873 20632 tablet_service.cc:1467] Processing CreateTablet for tablet 83ca7ec151a44da9b5a33ede047f8a3c (DEFAULT_TABLE table=test-table [id=bf445ce1c10f40f18cdf7dc0f3c457d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:19.031859 20825 tablet_service.cc:1467] Processing CreateTablet for tablet 83ca7ec151a44da9b5a33ede047f8a3c (DEFAULT_TABLE table=test-table [id=bf445ce1c10f40f18cdf7dc0f3c457d3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:19.032186 20450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83ca7ec151a44da9b5a33ede047f8a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:19.032194 20825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83ca7ec151a44da9b5a33ede047f8a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:19.032194 20632 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 83ca7ec151a44da9b5a33ede047f8a3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:19.034670 20941 tablet_bootstrap.cc:492] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699: Bootstrap starting.
I20260808 05:08:19.035269 20943 tablet_bootstrap.cc:492] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Bootstrap starting.
I20260808 05:08:19.035327 20941 tablet_bootstrap.cc:654] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:19.035779 20941 log.cc:824] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:19.035912 20943 tablet_bootstrap.cc:654] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:19.036181 20943 log.cc:824] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:19.036509 20942 tablet_bootstrap.cc:492] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Bootstrap starting.
I20260808 05:08:19.036567 20941 tablet_bootstrap.cc:492] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699: No bootstrap required, opened a new log
I20260808 05:08:19.036620 20941 ts_tablet_manager.cc:1397] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:19.036868 20943 tablet_bootstrap.cc:492] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: No bootstrap required, opened a new log
I20260808 05:08:19.036926 20943 ts_tablet_manager.cc:1397] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:19.037127 20942 tablet_bootstrap.cc:654] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:19.037474 20942 log.cc:824] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:19.038192 20942 tablet_bootstrap.cc:492] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: No bootstrap required, opened a new log
I20260808 05:08:19.038256 20942 ts_tablet_manager.cc:1397] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:08:19.038815 20941 raft_consensus.cc:348] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.038929 20941 raft_consensus.cc:374] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:19.038950 20941 raft_consensus.cc:729] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 639c280e2e0c4de6917628367bb6f699, State: Initialized, Role: FOLLOWER
I20260808 05:08:19.039055 20941 consensus_queue.cc:260] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.039306 20941 ts_tablet_manager.cc:1428] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:08:19.039345 20540 heartbeater.cc:503] Master 127.12.251.62:37473 was elected leader, sending a full tablet report...
I20260808 05:08:19.039274 20943 raft_consensus.cc:348] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.039415 20943 raft_consensus.cc:374] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:19.039459 20943 raft_consensus.cc:729] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3cb746acd8d41d39f9091894563e169, State: Initialized, Role: FOLLOWER
I20260808 05:08:19.039562 20943 consensus_queue.cc:260] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.039813 20943 ts_tablet_manager.cc:1428] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:08:19.039851 20731 heartbeater.cc:503] Master 127.12.251.62:37473 was elected leader, sending a full tablet report...
I20260808 05:08:19.040658 20942 raft_consensus.cc:348] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.040796 20942 raft_consensus.cc:374] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:19.040818 20942 raft_consensus.cc:729] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 997bb360ef004679a0a6e4015093749b, State: Initialized, Role: FOLLOWER
I20260808 05:08:19.040917 20942 consensus_queue.cc:260] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.041127 20942 ts_tablet_manager.cc:1428] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:08:19.041174 20921 heartbeater.cc:503] Master 127.12.251.62:37473 was elected leader, sending a full tablet report...
I20260808 05:08:19.050876 20950 raft_consensus.cc:482] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:19.050966 20950 raft_consensus.cc:504] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.051272 20950 leader_election.cc:288] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 997bb360ef004679a0a6e4015093749b (127.12.251.3:43379), 639c280e2e0c4de6917628367bb6f699 (127.12.251.1:43217)
I20260808 05:08:19.052424 20934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.051483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:55571 (local address 127.12.251.3:43379)
0808 05:08:19.051533 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.051535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.051544 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:19.051598 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.051598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.051603 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.051667 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.052200 (+ 533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.052201 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.052201 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.052205 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.052220 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.052224 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.052295 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.052348 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.052360 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:08:19.052424 20734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.051422 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:43379 (local address 127.12.251.2:55571)
0808 05:08:19.051490 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.051503 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.051539 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.051675 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.051676 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.051678 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:19.052118 (+ 440us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:19.052119 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:19.052125 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:19.052136 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:19.052302 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:19.052303 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:19.052304 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:19.052347 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:08:19.052360 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:08:19.052573 20952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.051438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43217 (local address 127.12.251.2:47021)
0808 05:08:19.051598 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.051608 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.051654 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.051768 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.051768 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.051770 (+ 2us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:19.052265 (+ 495us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:19.052265 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:19.052274 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:19.052287 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:19.052414 (+ 127us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:19.052415 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:19.052416 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:19.052474 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:08:19.052485 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":79,"threads_started":1}
I20260808 05:08:19.052680 20849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83ca7ec151a44da9b5a33ede047f8a3c" candidate_uuid: "e3cb746acd8d41d39f9091894563e169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "997bb360ef004679a0a6e4015093749b" is_pre_election: true
I20260808 05:08:19.052784 20938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.051498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:47021 (local address 127.12.251.1:43217)
0808 05:08:19.051550 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.051552 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.051660 (+ 108us) server_negotiation.cc:407] Connection header received
0808 05:08:19.051702 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.051702 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.051707 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.051764 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.052347 (+ 583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.052348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.052349 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.052353 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.052368 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.052371 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.052418 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.052718 (+ 300us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.052733 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:08:19.052798 20849 raft_consensus.cc:2454] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3cb746acd8d41d39f9091894563e169 in term 0.
I20260808 05:08:19.053014 20568 leader_election.cc:302] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 997bb360ef004679a0a6e4015093749b, e3cb746acd8d41d39f9091894563e169; no voters:
I20260808 05:08:19.053013 20477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83ca7ec151a44da9b5a33ede047f8a3c" candidate_uuid: "e3cb746acd8d41d39f9091894563e169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "639c280e2e0c4de6917628367bb6f699" is_pre_election: true
I20260808 05:08:19.053126 20477 raft_consensus.cc:2454] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3cb746acd8d41d39f9091894563e169 in term 0.
I20260808 05:08:19.053166 20950 raft_consensus.cc:2781] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:19.053262 20950 raft_consensus.cc:482] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:19.053297 20950 raft_consensus.cc:3037] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:19.053917 20950 raft_consensus.cc:504] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.054045 20950 leader_election.cc:288] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [CANDIDATE]: Term 1 election: Requested vote from peers 997bb360ef004679a0a6e4015093749b (127.12.251.3:43379), 639c280e2e0c4de6917628367bb6f699 (127.12.251.1:43217)
I20260808 05:08:19.054176 20849 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83ca7ec151a44da9b5a33ede047f8a3c" candidate_uuid: "e3cb746acd8d41d39f9091894563e169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "997bb360ef004679a0a6e4015093749b"
I20260808 05:08:19.054201 20477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "83ca7ec151a44da9b5a33ede047f8a3c" candidate_uuid: "e3cb746acd8d41d39f9091894563e169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "639c280e2e0c4de6917628367bb6f699"
I20260808 05:08:19.054245 20849 raft_consensus.cc:3037] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:19.054265 20477 raft_consensus.cc:3037] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:19.054840 20849 raft_consensus.cc:2454] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3cb746acd8d41d39f9091894563e169 in term 1.
I20260808 05:08:19.054941 20477 raft_consensus.cc:2454] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3cb746acd8d41d39f9091894563e169 in term 1.
I20260808 05:08:19.054999 20568 leader_election.cc:302] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 997bb360ef004679a0a6e4015093749b, e3cb746acd8d41d39f9091894563e169; no voters:
I20260808 05:08:19.055075 20950 raft_consensus.cc:2781] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:19.055207 20950 raft_consensus.cc:686] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 1 LEADER]: Becoming Leader. State: Replica: e3cb746acd8d41d39f9091894563e169, State: Running, Role: LEADER
I20260808 05:08:19.055280 20950 consensus_queue.cc:237] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } }
I20260808 05:08:19.055976 20272 catalog_manager.cc:5495] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 reported cstate change: term changed from 0 to 1, leader changed from <none> to e3cb746acd8d41d39f9091894563e169 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "e3cb746acd8d41d39f9091894563e169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3cb746acd8d41d39f9091894563e169" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 44899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:19.062409 20940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.061741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58892 (local address 127.12.251.2:44899)
0808 05:08:19.061773 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.061774 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.061780 (+ 6us) server_negotiation.cc:407] Connection header received
0808 05:08:19.061804 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.061805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.061814 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.061857 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.062286 (+ 429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.062286 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.062286 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.062288 (+ 2us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.062297 (+ 9us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.062299 (+ 2us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.062331 (+ 32us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.062361 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.062369 (+ 8us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:08:19.063789 20477 raft_consensus.cc:1261] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 1 FOLLOWER]: Refusing update from remote peer e3cb746acd8d41d39f9091894563e169: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:19.063793 20849 raft_consensus.cc:1261] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 1 FOLLOWER]: Refusing update from remote peer e3cb746acd8d41d39f9091894563e169: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:19.064056 20950 consensus_queue.cc:1035] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "997bb360ef004679a0a6e4015093749b" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 43379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:19.064177 20953 consensus_queue.cc:1035] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "639c280e2e0c4de6917628367bb6f699" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:19.066277 20958 mvcc.cc:205] Tried to move back new op lower bound from 7316134703363268608 to 7316134703330947072. Current Snapshot: MvccSnapshot[applied={T|T < 7316134703363268608}]
I20260808 05:08:19.068512 20272 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:19.068583 20272 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40222:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:19.069180 20272 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 942ad794d140486a95d1a006f3120164: Sending DeleteTablet for 3 replicas of tablet 83ca7ec151a44da9b5a33ede047f8a3c
I20260808 05:08:19.069478 20825 tablet_service.cc:1514] Processing DeleteTablet for tablet 83ca7ec151a44da9b5a33ede047f8a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:19 UTC) from {username='slave'} at 127.0.0.1:49852
I20260808 05:08:19.069509 20450 tablet_service.cc:1514] Processing DeleteTablet for tablet 83ca7ec151a44da9b5a33ede047f8a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:19 UTC) from {username='slave'} at 127.0.0.1:56382
I20260808 05:08:19.069543 20632 tablet_service.cc:1514] Processing DeleteTablet for tablet 83ca7ec151a44da9b5a33ede047f8a3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:19 UTC) from {username='slave'} at 127.0.0.1:58882
I20260808 05:08:19.069723 20973 tablet_replica.cc:330] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699: stopping tablet replica
I20260808 05:08:19.069818 20973 raft_consensus.cc:2229] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:19.069908 20973 raft_consensus.cc:2258] T 83ca7ec151a44da9b5a33ede047f8a3c P 639c280e2e0c4de6917628367bb6f699 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:19.069934 20972 tablet_replica.cc:330] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: stopping tablet replica
I20260808 05:08:19.069990 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 20359
I20260808 05:08:19.072382 20974 tablet_replica.cc:330] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: stopping tablet replica
I20260808 05:08:19.072484 20974 raft_consensus.cc:2229] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:19.072623 20974 raft_consensus.cc:2258] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:19.078132 20974 ts_tablet_manager.cc:1905] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:19.080258 20974 ts_tablet_manager.cc:1918] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:19.080324 20974 log.cc:1196] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/83ca7ec151a44da9b5a33ede047f8a3c
I20260808 05:08:19.080572 20974 ts_tablet_manager.cc:1939] T 83ca7ec151a44da9b5a33ede047f8a3c P e3cb746acd8d41d39f9091894563e169: Deleting consensus metadata
I20260808 05:08:19.080730 20972 raft_consensus.cc:2229] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:19.080916 20972 raft_consensus.cc:2258] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:19.080991 20254 catalog_manager.cc:4841] TS e3cb746acd8d41d39f9091894563e169 (127.12.251.2:44899): tablet 83ca7ec151a44da9b5a33ede047f8a3c (table test-table [id=bf445ce1c10f40f18cdf7dc0f3c457d3]) successfully deleted
I20260808 05:08:19.081523 20972 ts_tablet_manager.cc:1905] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:19.083009 20972 ts_tablet_manager.cc:1918] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:19.083083 20972 log.cc:1196] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/83ca7ec151a44da9b5a33ede047f8a3c
I20260808 05:08:19.083323 20972 ts_tablet_manager.cc:1939] T 83ca7ec151a44da9b5a33ede047f8a3c P 997bb360ef004679a0a6e4015093749b: Deleting consensus metadata
I20260808 05:08:19.083735 20254 catalog_manager.cc:4841] TS 997bb360ef004679a0a6e4015093749b (127.12.251.3:43379): tablet 83ca7ec151a44da9b5a33ede047f8a3c (table test-table [id=bf445ce1c10f40f18cdf7dc0f3c457d3]) successfully deleted
W20260808 05:08:19.087797 20256 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:43217 (error 108)
I20260808 05:08:19.087924 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 20543
I20260808 05:08:19.091310 20930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.090437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43217 (local address 127.0.0.1:56396)
0808 05:08:19.091219 (+ 782us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.091264 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:43217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":762}
W20260808 05:08:19.091435 20256 catalog_manager.cc:4584] TS 639c280e2e0c4de6917628367bb6f699 (127.12.251.1:43217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 83ca7ec151a44da9b5a33ede047f8a3c: Network error: Client connection negotiation failed: client connection to 127.12.251.1:43217: connect: Connection refused (error 111)
I20260808 05:08:19.097383 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 20735
I20260808 05:08:19.104828 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 20228
2026-08-08T05:08:19Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (599 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260808 05:08:19.131232 13292 mini_oidc.cc:152] Starting JWKS server
I20260808 05:08:19.132565 13292 webserver.cc:460] Webserver started at https://127.0.0.1:44229/ using document root <none> and password file <none>
I20260808 05:08:19.132652 13292 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:08:19.132808 13292 webserver.cc:460] Webserver started at http://127.0.0.1:40229/ using document root <none> and password file <none>
2026-08-08T05:08:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:19Z Disabled control of system clock
I20260808 05:08:19.141050 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42843
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:35657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:42843
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44229/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/testchainca.cert with env {}
W20260808 05:08:19.220217 20983 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:19.220423 20983 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:19.220461 20983 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:19.221611 20983 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:19.221649 20983 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:19.221665 20983 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:19.221681 20983 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:19.221696 20983 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:08:19.221712 20983 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:08:19.221731 20983 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44229/jwks.json
I20260808 05:08:19.223243 20983 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:42843
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44229/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20983
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:19.223486 20983 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:19.223672 20983 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:19.228279 20998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:19.228279 20994 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.228461 20983 server_base.cc:1034] running on GCE node
W20260808 05:08:19.228313 20992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.228755 20983 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:19.229038 20983 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:19.230178 20983 hybrid_clock.cc:648] HybridClock initialized: now 1786165699230148 us; error 42 us; skew 500 ppm
I20260808 05:08:19.231338 20983 webserver.cc:460] Webserver started at http://127.12.251.62:40395/ using document root <none> and password file <none>
I20260808 05:08:19.231554 20983 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:19.231602 20983 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:19.231724 20983 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:19.232758 20983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "58011ae979dc43b586f1d24370bf1d10"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "aca8c9a14ed08c08cf8f48019593fc5b"
server_key_iv: "f31bc7d366d8131b2eebf5c76d71cc80"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.233088 20983 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "58011ae979dc43b586f1d24370bf1d10"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "aca8c9a14ed08c08cf8f48019593fc5b"
server_key_iv: "f31bc7d366d8131b2eebf5c76d71cc80"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.234314 20983 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:19.234999 21006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:19.235143 20983 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:19.235227 20983 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "58011ae979dc43b586f1d24370bf1d10"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "aca8c9a14ed08c08cf8f48019593fc5b"
server_key_iv: "f31bc7d366d8131b2eebf5c76d71cc80"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.235293 20983 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:19.273609 20983 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:19.273942 20983 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:19.274076 20983 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:19.277856 20983 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:42843
I20260808 05:08:19.277910 21083 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:42843 every 8 connection(s)
I20260808 05:08:19.278280 20983 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:19.279434 21084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:19.281828 21084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10: Bootstrap starting.
I20260808 05:08:19.282392 21084 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:19.282680 21084 log.cc:824] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:19.283313 21084 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10: No bootstrap required, opened a new log
I20260808 05:08:19.284852 21084 raft_consensus.cc:348] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58011ae979dc43b586f1d24370bf1d10" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42843 } }
I20260808 05:08:19.284991 21084 raft_consensus.cc:374] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:19.285025 21084 raft_consensus.cc:729] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58011ae979dc43b586f1d24370bf1d10, State: Initialized, Role: FOLLOWER
I20260808 05:08:19.285190 21084 consensus_queue.cc:260] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58011ae979dc43b586f1d24370bf1d10" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42843 } }
I20260808 05:08:19.285256 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 20983
I20260808 05:08:19.285290 21084 raft_consensus.cc:388] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:19.285328 21084 raft_consensus.cc:482] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:19.285351 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:19.285375 21084 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:19.285532 13292 external_mini_cluster.cc:1428] Setting key 8682e38b64faa622e5a5622bbfb9d671
I20260808 05:08:19.285970 21084 raft_consensus.cc:504] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58011ae979dc43b586f1d24370bf1d10" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42843 } }
I20260808 05:08:19.286080 21084 leader_election.cc:302] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 58011ae979dc43b586f1d24370bf1d10; no voters:
I20260808 05:08:19.286223 21084 leader_election.cc:288] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:19.286296 21090 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:19.286450 21090 raft_consensus.cc:686] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [term 1 LEADER]: Becoming Leader. State: Replica: 58011ae979dc43b586f1d24370bf1d10, State: Running, Role: LEADER
I20260808 05:08:19.286475 21084 sys_catalog.cc:564] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:19.286566 21090 consensus_queue.cc:237] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58011ae979dc43b586f1d24370bf1d10" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42843 } }
I20260808 05:08:19.287148 21094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 58011ae979dc43b586f1d24370bf1d10. Latest consensus state: current_term: 1 leader_uuid: "58011ae979dc43b586f1d24370bf1d10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58011ae979dc43b586f1d24370bf1d10" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42843 } } }
I20260808 05:08:19.287254 21094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.287417 21091 sys_catalog.cc:455] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "58011ae979dc43b586f1d24370bf1d10" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "58011ae979dc43b586f1d24370bf1d10" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42843 } } }
I20260808 05:08:19.287492 21091 sys_catalog.cc:458] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.287611 21104 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:19.288059 21104 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:19.290953 21104 catalog_manager.cc:1347] Generated new cluster ID: 67457d304ffb49949499b7709a6aa80f
I20260808 05:08:19.290998 21104 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:19.291775 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.286010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59384 (local address 127.12.251.62:42843)
0808 05:08:19.286258 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.286268 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.286305 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:08:19.286425 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.286432 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.286501 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.286890 (+ 389us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.286993 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.288736 (+ 1743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.289843 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.290266 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.290355 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.291068 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.291072 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.291072 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.291274 (+ 202us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.291330 (+ 56us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.291343 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.291400 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.291503 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.291578 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":103,"threads_started":1}
I20260808 05:08:19.292780 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:08:19.298309 21104 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:19.298779 21104 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:19.311596 21104 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 58011ae979dc43b586f1d24370bf1d10: Generated new TSK 0
I20260808 05:08:19.311764 21104 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 05:08:19.339107 21126 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260808 05:08:19.339252 21126 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 05:08:19.339443 21089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.324214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59392 (local address 127.12.251.62:42843)
0808 05:08:19.324269 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.324272 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.324407 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:08:19.324509 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.324509 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.324518 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.324572 (+ 54us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:08:19.324735 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.325255 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.326334 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.326524 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.326565 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.326776 (+ 211us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:08:19.339200 (+ 12424us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44229/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 05:08:19.339374 (+ 174us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:59392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44229/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":30}
W20260808 05:08:19.339494 21089 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:59392: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44229/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260808 05:08:19.340058 21124 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:19.324150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42843 (local address 127.0.0.1:59392)
0808 05:08:19.324341 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.324353 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.324425 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.324591 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.324592 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.324595 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:08:19.324675 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.324679 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.325321 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.325322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.326265 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.326267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.326586 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.326588 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.326656 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.326681 (+ 25us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:08:19.339429 (+ 12748us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44229/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0808 05:08:19.339636 (+ 207us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.251.62:42843: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44229/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":79,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.251.62:42843: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44229/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260808 05:08:19.340483 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 20983
2026-08-08T05:08:19Z chronyd exiting
I20260808 05:08:19.384500 13292 test_util.cc:175] -----------------------------------------------
I20260808 05:08:19.384574 13292 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786165676707025-13292-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (254 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260808 05:08:19.385337 13292 mini_oidc.cc:152] Starting JWKS server
I20260808 05:08:19.386015 13292 webserver.cc:460] Webserver started at https://127.0.0.1:33803/ using document root <none> and password file <none>
I20260808 05:08:19.386058 13292 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:08:19.386191 13292 webserver.cc:460] Webserver started at http://127.0.0.1:37831/ using document root <none> and password file <none>
2026-08-08T05:08:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:19Z Disabled control of system clock
I20260808 05:08:19.394352 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36741
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:37029
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:36741
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33803/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/testchainca.cert with env {}
W20260808 05:08:19.473234 21133 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:19.473421 21133 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:19.473449 21133 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:19.474532 21133 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:19.474567 21133 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:19.474578 21133 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:19.474589 21133 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:19.474606 21133 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:08:19.474622 21133 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:08:19.474632 21133 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33803/jwks.json
I20260808 05:08:19.476029 21133 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:37029
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:36741
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36741
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33803/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21133
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:19.476212 21133 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:19.476364 21133 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:19.480893 21138 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.480973 21133 server_base.cc:1034] running on GCE node
W20260808 05:08:19.480922 21139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:19.480906 21141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.481339 21133 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:19.481591 21133 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:19.482717 21133 hybrid_clock.cc:648] HybridClock initialized: now 1786165699482708 us; error 30 us; skew 500 ppm
I20260808 05:08:19.483846 21133 webserver.cc:460] Webserver started at http://127.12.251.62:41417/ using document root <none> and password file <none>
I20260808 05:08:19.484043 21133 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:19.484089 21133 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:19.484195 21133 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:19.485167 21133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "b0aec79388c443d3867e3aae77f55a8d"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "9a91d435926b8b13f07918629050d47b"
server_key_iv: "7ade26e07d4d2c85c52a95be001b229f"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.485530 21133 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "b0aec79388c443d3867e3aae77f55a8d"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "9a91d435926b8b13f07918629050d47b"
server_key_iv: "7ade26e07d4d2c85c52a95be001b229f"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.486742 21133 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:19.487450 21151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:19.487591 21133 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:19.487671 21133 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "b0aec79388c443d3867e3aae77f55a8d"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "9a91d435926b8b13f07918629050d47b"
server_key_iv: "7ade26e07d4d2c85c52a95be001b229f"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.487736 21133 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:19.496047 21133 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:19.496294 21133 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:19.496415 21133 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:19.500169 21133 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:36741
I20260808 05:08:19.500200 21230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:36741 every 8 connection(s)
I20260808 05:08:19.500499 21133 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:19.501142 21231 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:19.503916 21231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d: Bootstrap starting.
I20260808 05:08:19.504446 21231 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:19.504680 21231 log.cc:824] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:19.505375 21231 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d: No bootstrap required, opened a new log
I20260808 05:08:19.506929 21231 raft_consensus.cc:348] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0aec79388c443d3867e3aae77f55a8d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36741 } }
I20260808 05:08:19.507081 21231 raft_consensus.cc:374] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:19.507103 21231 raft_consensus.cc:729] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0aec79388c443d3867e3aae77f55a8d, State: Initialized, Role: FOLLOWER
I20260808 05:08:19.507208 21231 consensus_queue.cc:260] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0aec79388c443d3867e3aae77f55a8d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36741 } }
I20260808 05:08:19.507257 21231 raft_consensus.cc:388] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:19.507277 21231 raft_consensus.cc:482] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:19.507303 21231 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:19.507763 21231 raft_consensus.cc:504] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0aec79388c443d3867e3aae77f55a8d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36741 } }
I20260808 05:08:19.507848 21231 leader_election.cc:302] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b0aec79388c443d3867e3aae77f55a8d; no voters:
I20260808 05:08:19.507973 21231 leader_election.cc:288] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:19.508016 21235 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:19.508159 21235 raft_consensus.cc:686] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [term 1 LEADER]: Becoming Leader. State: Replica: b0aec79388c443d3867e3aae77f55a8d, State: Running, Role: LEADER
I20260808 05:08:19.508152 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 21133
I20260808 05:08:19.508239 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:19.508239 21231 sys_catalog.cc:564] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:19.508270 21235 consensus_queue.cc:237] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0aec79388c443d3867e3aae77f55a8d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36741 } }
I20260808 05:08:19.508450 13292 external_mini_cluster.cc:1428] Setting key b0bbfe1fb841a139da533248ba7afe51
I20260808 05:08:19.508584 21235 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [sys.catalog]: SysCatalogTable state changed. Reason: New leader b0aec79388c443d3867e3aae77f55a8d. Latest consensus state: current_term: 1 leader_uuid: "b0aec79388c443d3867e3aae77f55a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0aec79388c443d3867e3aae77f55a8d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36741 } } }
I20260808 05:08:19.508664 21235 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.508596 21238 sys_catalog.cc:455] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b0aec79388c443d3867e3aae77f55a8d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b0aec79388c443d3867e3aae77f55a8d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36741 } } }
I20260808 05:08:19.508736 21238 sys_catalog.cc:458] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.509454 21244 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:19.509970 21244 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:19.511550 21244 catalog_manager.cc:1347] Generated new cluster ID: fb36e898c87d48f9899b45cb601588c9
I20260808 05:08:19.511606 21244 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:19.514853 21250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.509096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42144 (local address 127.12.251.62:36741)
0808 05:08:19.509715 (+ 619us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.509725 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.509774 (+ 49us) server_negotiation.cc:407] Connection header received
0808 05:08:19.509890 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.509897 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.509966 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.510417 (+ 451us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.510521 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.511627 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.512706 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.513332 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.513439 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.514168 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.514172 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.514172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.514371 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.514410 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.514423 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.514480 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.514568 (+ 88us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.514644 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":526,"thread_start_us":73,"threads_started":1}
I20260808 05:08:19.515777 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:08:19.522863 21244 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:19.523543 21244 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:19.532375 21244 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b0aec79388c443d3867e3aae77f55a8d: Generated new TSK 0
I20260808 05:08:19.532549 21244 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260808 05:08:19.551867 21278 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260808 05:08:19.551939 21278 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260808 05:08:19.552313 21250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.538083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42146 (local address 127.12.251.62:36741)
0808 05:08:19.538126 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.538128 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.538245 (+ 117us) server_negotiation.cc:407] Connection header received
0808 05:08:19.538288 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.538289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.538301 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.538381 (+ 80us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:08:19.538476 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.539289 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.539988 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.540310 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.540372 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.540495 (+ 123us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:08:19.552073 (+ 11578us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 05:08:19.552233 (+ 160us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:42146: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:08:19.552358 21276 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:19.538003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36741 (local address 127.0.0.1:42146)
0808 05:08:19.538182 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.538191 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.538242 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.538377 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.538377 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.538379 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:08:19.538436 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.538437 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.539353 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.539353 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.539921 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.539922 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.540382 (+ 460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.540383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.540420 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.540425 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:08:19.552185 (+ 11760us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0808 05:08:19.552280 (+ 95us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.251.62:36741: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":84,"threads_started":1}
W20260808 05:08:19.552377 21250 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:42146: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33803/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
I20260808 05:08:19.552776 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 21133
2026-08-08T05:08:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (214 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260808 05:08:19.599331 13292 mini_oidc.cc:152] Starting JWKS server
I20260808 05:08:19.599992 13292 webserver.cc:460] Webserver started at https://127.0.0.1:42243/ using document root <none> and password file <none>
I20260808 05:08:19.600034 13292 mini_oidc.cc:189] Starting OIDC Discovery server
I20260808 05:08:19.600143 13292 webserver.cc:460] Webserver started at http://127.0.0.1:46839/ using document root <none> and password file <none>
2026-08-08T05:08:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:19Z Disabled control of system clock
I20260808 05:08:19.608502 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:37017
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:46799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:37017
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42243/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 05:08:19.688052 21285 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:19.688251 21285 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:19.688279 21285 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:19.689409 21285 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:19.689455 21285 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:19.689473 21285 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:19.689489 21285 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:19.689505 21285 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:08:19.689525 21285 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:08:19.689548 21285 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:42243/jwks.json
I20260808 05:08:19.691462 21285 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:37017
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:37017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:42243/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21285
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:19.691723 21285 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:19.692056 21285 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:19.697556 21294 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:19.697619 21297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.697605 21285 server_base.cc:1034] running on GCE node
W20260808 05:08:19.697566 21295 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.697986 21285 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:19.698287 21285 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:19.699429 21285 hybrid_clock.cc:648] HybridClock initialized: now 1786165699699400 us; error 41 us; skew 500 ppm
I20260808 05:08:19.700588 21285 webserver.cc:460] Webserver started at http://127.12.251.62:41775/ using document root <none> and password file <none>
I20260808 05:08:19.700809 21285 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:19.700858 21285 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:19.700995 21285 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:19.702059 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "e3feb8f38ebd453690dd7e1ad916c8ee"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "3679a80a93c700da7b628e494f186de3"
server_key_iv: "c52cbcc8dfad8c2f2ad48247fa8919bc"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.702391 21285 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "e3feb8f38ebd453690dd7e1ad916c8ee"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "3679a80a93c700da7b628e494f186de3"
server_key_iv: "c52cbcc8dfad8c2f2ad48247fa8919bc"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.703603 21285 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:08:19.704260 21309 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:19.704406 21285 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:19.704469 21285 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "e3feb8f38ebd453690dd7e1ad916c8ee"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "3679a80a93c700da7b628e494f186de3"
server_key_iv: "c52cbcc8dfad8c2f2ad48247fa8919bc"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.704535 21285 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:19.714078 21285 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:19.714313 21285 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:19.714411 21285 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:19.718050 21285 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:37017
I20260808 05:08:19.718113 21391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:37017 every 8 connection(s)
I20260808 05:08:19.718382 21285 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:19.719033 21392 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:19.721679 21392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee: Bootstrap starting.
I20260808 05:08:19.722227 21392 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:19.722232 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 21285
I20260808 05:08:19.722316 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:19.722481 13292 external_mini_cluster.cc:1428] Setting key 1c538220b9ed2af05148a463653247c9
I20260808 05:08:19.722513 21392 log.cc:824] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:19.723260 21392 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee: No bootstrap required, opened a new log
I20260808 05:08:19.725404 21392 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37017 } }
I20260808 05:08:19.725571 21392 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:19.725616 21392 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3feb8f38ebd453690dd7e1ad916c8ee, State: Initialized, Role: FOLLOWER
I20260808 05:08:19.725732 21392 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37017 } }
I20260808 05:08:19.725800 21392 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:19.725835 21392 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:19.725879 21392 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:19.726550 21392 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37017 } }
I20260808 05:08:19.726667 21392 leader_election.cc:302] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3feb8f38ebd453690dd7e1ad916c8ee; no voters:
I20260808 05:08:19.726822 21392 leader_election.cc:288] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:19.726891 21397 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:19.727048 21397 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [term 1 LEADER]: Becoming Leader. State: Replica: e3feb8f38ebd453690dd7e1ad916c8ee, State: Running, Role: LEADER
I20260808 05:08:19.727069 21392 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:19.727141 21397 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37017 } }
I20260808 05:08:19.727497 21399 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3feb8f38ebd453690dd7e1ad916c8ee. Latest consensus state: current_term: 1 leader_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37017 } } }
I20260808 05:08:19.727578 21399 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.727914 21400 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3feb8f38ebd453690dd7e1ad916c8ee" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 37017 } } }
I20260808 05:08:19.728039 21400 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.728252 21396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.722963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37954 (local address 127.12.251.62:37017)
0808 05:08:19.723153 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.723161 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.723185 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:08:19.723639 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.723646 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.723705 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.723813 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.724046 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.724874 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.725991 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.726593 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.726727 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.727442 (+ 715us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.727447 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.727448 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.727669 (+ 221us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.727715 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.727732 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.727802 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.727979 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.728064 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
W20260808 05:08:19.728955 21416 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:08:19.729020 21416 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:08:19.729063 21406 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:19.729197 21406 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:19.729810 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:08:19.730880 21406 catalog_manager.cc:1347] Generated new cluster ID: 60b0da66f0f74d4aade6e341a477b1dd
I20260808 05:08:19.730935 21406 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:19.735110 21406 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:19.735572 21406 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:19.742061 21406 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3feb8f38ebd453690dd7e1ad916c8ee: Generated new TSK 0
I20260808 05:08:19.742208 21406 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:08:19.753602 21396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.750468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37970 (local address 127.12.251.62:37017)
0808 05:08:19.750511 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.750513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.750621 (+ 108us) server_negotiation.cc:407] Connection header received
0808 05:08:19.750705 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.750706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.750718 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.750779 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:08:19.750904 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.751392 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.752153 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.752350 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.752402 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.752563 (+ 161us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:08:19.753402 (+ 839us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42243/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 05:08:19.753538 (+ 136us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37970: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42243/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 05:08:19.753654 21396 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37970: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42243/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260808 05:08:19.753705 21427 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:19.750383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:37017 (local address 127.0.0.1:37970)
0808 05:08:19.750554 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.750563 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.750639 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.750784 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.750785 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.750787 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:08:19.750846 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.750848 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.751486 (+ 638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.751487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.752073 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.752075 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.752416 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.752417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.752472 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.752477 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:08:19.753500 (+ 1023us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42243/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0808 05:08:19.753604 (+ 104us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.251.62:37017: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:42243/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260808 05:08:19.754191 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 21285
E20260808 05:08:19.773084 21428 webserver.cc:533] Webserver: sslize failed:
E20260808 05:08:19.773156 21428 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-08T05:08:19Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (200 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-08T05:08:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:19Z Disabled control of system clock
I20260808 05:08:19.808462 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:40095
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:33329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:40095
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/testchainca.cert with env {}
W20260808 05:08:19.889591 21437 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:19.889810 21437 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:19.889842 21437 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:19.891022 21437 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:19.891064 21437 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:19.891081 21437 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:19.891098 21437 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:19.891111 21437 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260808 05:08:19.891129 21437 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260808 05:08:19.891146 21437 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260808 05:08:19.892692 21437 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:40095
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:40095
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21437
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:19.892957 21437 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:19.893167 21437 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:19.897897 21443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:19.897898 21445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.898061 21437 server_base.cc:1034] running on GCE node
W20260808 05:08:19.897918 21447 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:19.898406 21437 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:19.898702 21437 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:19.899848 21437 hybrid_clock.cc:648] HybridClock initialized: now 1786165699899826 us; error 33 us; skew 500 ppm
I20260808 05:08:19.900988 21437 webserver.cc:460] Webserver started at http://127.12.251.62:37427/ using document root <none> and password file <none>
I20260808 05:08:19.901234 21437 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:19.901299 21437 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:19.901428 21437 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:19.902522 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "dae1aba4612046a69dd4ef57902fd97f"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "1e24e8a702e75db6fd3a281748f81e94"
server_key_iv: "5c7f27ec6b638e5985ca681df617c883"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.902854 21437 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "dae1aba4612046a69dd4ef57902fd97f"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "1e24e8a702e75db6fd3a281748f81e94"
server_key_iv: "5c7f27ec6b638e5985ca681df617c883"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.904049 21437 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:19.904706 21455 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:19.904853 21437 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:19.904935 21437 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "dae1aba4612046a69dd4ef57902fd97f"
format_stamp: "Formatted at 2026-08-08 05:08:19 on dist-test-slave-bndk"
server_key: "1e24e8a702e75db6fd3a281748f81e94"
server_key_iv: "5c7f27ec6b638e5985ca681df617c883"
server_key_version: "encryptionkey@0"
I20260808 05:08:19.904994 21437 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:19.914119 21437 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:19.914371 21437 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:19.914500 21437 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:19.918267 21437 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:40095
I20260808 05:08:19.918299 21526 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:40095 every 8 connection(s)
I20260808 05:08:19.918605 21437 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:19.919524 21527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:19.921847 21527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f: Bootstrap starting.
I20260808 05:08:19.922402 21527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:19.922399 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 21437
I20260808 05:08:19.922487 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:19.922652 13292 external_mini_cluster.cc:1428] Setting key 340ec28d28cd779cd710023d62d234be
I20260808 05:08:19.922703 21527 log.cc:824] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:19.923445 21527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f: No bootstrap required, opened a new log
I20260808 05:08:19.925590 21527 raft_consensus.cc:348] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae1aba4612046a69dd4ef57902fd97f" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40095 } }
I20260808 05:08:19.925765 21527 raft_consensus.cc:374] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:19.925802 21527 raft_consensus.cc:729] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dae1aba4612046a69dd4ef57902fd97f, State: Initialized, Role: FOLLOWER
I20260808 05:08:19.925925 21527 consensus_queue.cc:260] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae1aba4612046a69dd4ef57902fd97f" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40095 } }
I20260808 05:08:19.926018 21527 raft_consensus.cc:388] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:19.926057 21527 raft_consensus.cc:482] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:19.926110 21527 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:19.926708 21527 raft_consensus.cc:504] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae1aba4612046a69dd4ef57902fd97f" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40095 } }
I20260808 05:08:19.926821 21527 leader_election.cc:302] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dae1aba4612046a69dd4ef57902fd97f; no voters:
I20260808 05:08:19.926985 21527 leader_election.cc:288] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:19.927043 21535 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:19.927193 21535 raft_consensus.cc:686] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [term 1 LEADER]: Becoming Leader. State: Replica: dae1aba4612046a69dd4ef57902fd97f, State: Running, Role: LEADER
I20260808 05:08:19.927240 21527 sys_catalog.cc:564] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:19.927292 21535 consensus_queue.cc:237] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae1aba4612046a69dd4ef57902fd97f" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40095 } }
I20260808 05:08:19.927654 21537 sys_catalog.cc:455] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [sys.catalog]: SysCatalogTable state changed. Reason: New leader dae1aba4612046a69dd4ef57902fd97f. Latest consensus state: current_term: 1 leader_uuid: "dae1aba4612046a69dd4ef57902fd97f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae1aba4612046a69dd4ef57902fd97f" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40095 } } }
I20260808 05:08:19.927747 21537 sys_catalog.cc:458] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.927661 21536 sys_catalog.cc:455] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dae1aba4612046a69dd4ef57902fd97f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dae1aba4612046a69dd4ef57902fd97f" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40095 } } }
I20260808 05:08:19.927932 21536 sys_catalog.cc:458] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:19.928223 21534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.923085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41296 (local address 127.12.251.62:40095)
0808 05:08:19.923269 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.923278 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.923304 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:08:19.923760 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.923768 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.923827 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.923941 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:19.924166 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.925024 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.926112 (+ 1088us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.926563 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.926656 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.927454 (+ 798us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:19.927459 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:19.927460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:19.927664 (+ 204us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:19.927707 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:19.927723 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:19.927766 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:19.927938 (+ 172us) server_negotiation.cc:299] Negotiation successful
0808 05:08:19.928038 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":79,"threads_started":1}
I20260808 05:08:19.928509 21544 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:19.929025 21544 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:19.929184 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:08:19.930397 21544 catalog_manager.cc:1347] Generated new cluster ID: aa21638d25fa4f4ea48fe07c56aaa795
I20260808 05:08:19.930452 21544 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:19.938115 21544 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:19.938607 21544 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:19.942414 21544 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dae1aba4612046a69dd4ef57902fd97f: Generated new TSK 0
I20260808 05:08:19.942579 21544 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:08:20.392172 21534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:19.951539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41302 (local address 127.12.251.62:40095)
0808 05:08:19.951598 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:19.951600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:19.951631 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:08:19.951705 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:19.951706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:19.951717 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:19.951796 (+ 79us) server_negotiation.cc:226] Negotiated authn=JWT
0808 05:08:19.951892 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.952694 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.953483 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.953798 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.953868 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.953978 (+ 110us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0808 05:08:20.391937 (+437959us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 05:08:20.392110 (+ 173us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41302: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":35}
W20260808 05:08:20.392248 21534 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:41302: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260808 05:08:20.392330 21566 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:19.951427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:40095 (local address 127.0.0.1:41302)
0808 05:08:19.951577 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:19.951587 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:19.951643 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:19.951794 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:19.951795 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:19.951796 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0808 05:08:19.951844 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.951846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.952762 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.952763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.953400 (+ 637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:19.953403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:19.953867 (+ 464us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:19.953868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:19.953904 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:19.953909 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0808 05:08:20.392112 (+438203us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0808 05:08:20.392225 (+ 113us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.251.62:40095: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":87,"threads_started":1}
I20260808 05:08:20.392644 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 21437
2026-08-08T05:08:20Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (615 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (90 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (87 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:20 dist-test-slave-bndk krb5kdc[21579](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:20 dist-test-slave-bndk krb5kdc[21579](info): set up 2 sockets
Aug 08 05:08:20 dist-test-slave-bndk krb5kdc[21579](info): commencing operation
krb5kdc: starting...
W20260808 05:08:21.692793 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.098s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:21 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:21.811188 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:35009
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:35009
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:21.892081 21599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:21.892279 21599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:21.892300 21599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:21.893424 21599 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:21.893468 21599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:21.893486 21599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:21.893497 21599 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:21.893512 21599 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:21.894919 21599 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:35009
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:35009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:21.895145 21599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:21.895352 21599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:21.900079 21605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:21.900220 21599 server_base.cc:1034] running on GCE node
W20260808 05:08:21.900180 21611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:21.900084 21604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:21.900499 21599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:21.900764 21599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:21.901901 21599 hybrid_clock.cc:648] HybridClock initialized: now 1786165701901881 us; error 35 us; skew 500 ppm
Aug 08 05:08:21 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165701, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:21.904217 21599 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:21.904627 21599 webserver.cc:460] Webserver started at http://127.12.251.62:35599/ using document root <none> and password file <none>
I20260808 05:08:21.904831 21599 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:21.904879 21599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:21.905018 21599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:21.906090 21599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "59a5e01477b140599cff1df2bbcd8f66"
format_stamp: "Formatted at 2026-08-08 05:08:21 on dist-test-slave-bndk"
server_key: "7d4ae694588bfb905524d572b96442b4"
server_key_iv: "964c57d65e70984909c02351a95c0f64"
server_key_version: "encryptionkey@0"
I20260808 05:08:21.906422 21599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "59a5e01477b140599cff1df2bbcd8f66"
format_stamp: "Formatted at 2026-08-08 05:08:21 on dist-test-slave-bndk"
server_key: "7d4ae694588bfb905524d572b96442b4"
server_key_iv: "964c57d65e70984909c02351a95c0f64"
server_key_version: "encryptionkey@0"
I20260808 05:08:21.907724 21599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:21.908370 21622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:21.908542 21599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:21.908623 21599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "59a5e01477b140599cff1df2bbcd8f66"
format_stamp: "Formatted at 2026-08-08 05:08:21 on dist-test-slave-bndk"
server_key: "7d4ae694588bfb905524d572b96442b4"
server_key_iv: "964c57d65e70984909c02351a95c0f64"
server_key_version: "encryptionkey@0"
I20260808 05:08:21.908684 21599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:21.918490 21599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:21.920081 21599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:21.920202 21599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:21.924284 21599 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:35009
I20260808 05:08:21.924315 21695 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:35009 every 8 connection(s)
I20260808 05:08:21.924630 21599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:21.925527 21696 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:21.925625 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 21599
I20260808 05:08:21.925733 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:21.925899 13292 external_mini_cluster.cc:1428] Setting key 5760ccbe72a1d1ba7f0eff58934e689e
I20260808 05:08:21.928781 21696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66: Bootstrap starting.
I20260808 05:08:21.929499 21696 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:21.929762 21696 log.cc:824] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:21.930374 21696 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66: No bootstrap required, opened a new log
Aug 08 05:08:21 dist-test-slave-bndk krb5kdc[21579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165701, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:21.932508 21696 raft_consensus.cc:348] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a5e01477b140599cff1df2bbcd8f66" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35009 } }
I20260808 05:08:21.932682 21696 raft_consensus.cc:374] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:21.932726 21696 raft_consensus.cc:729] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59a5e01477b140599cff1df2bbcd8f66, State: Initialized, Role: FOLLOWER
I20260808 05:08:21.932861 21696 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a5e01477b140599cff1df2bbcd8f66" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35009 } }
I20260808 05:08:21.932956 21696 raft_consensus.cc:388] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:21.933007 21696 raft_consensus.cc:482] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:21.933060 21696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:21.933741 21696 raft_consensus.cc:504] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a5e01477b140599cff1df2bbcd8f66" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35009 } }
I20260808 05:08:21.933852 21696 leader_election.cc:302] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59a5e01477b140599cff1df2bbcd8f66; no voters:
I20260808 05:08:21.934022 21696 leader_election.cc:288] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:21.934057 21705 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:21.934201 21705 raft_consensus.cc:686] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [term 1 LEADER]: Becoming Leader. State: Replica: 59a5e01477b140599cff1df2bbcd8f66, State: Running, Role: LEADER
I20260808 05:08:21.934278 21696 sys_catalog.cc:564] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:21.934293 21705 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a5e01477b140599cff1df2bbcd8f66" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35009 } }
I20260808 05:08:21.934722 21707 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59a5e01477b140599cff1df2bbcd8f66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a5e01477b140599cff1df2bbcd8f66" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35009 } } }
I20260808 05:08:21.934739 21709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59a5e01477b140599cff1df2bbcd8f66. Latest consensus state: current_term: 1 leader_uuid: "59a5e01477b140599cff1df2bbcd8f66" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59a5e01477b140599cff1df2bbcd8f66" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35009 } } }
I20260808 05:08:21.934815 21707 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:21.934820 21709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:21.935640 21715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:21.936218 21715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:21.936512 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:21.926393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36190 (local address 127.12.251.62:35009)
0808 05:08:21.926587 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:21.926598 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:21.926632 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:08:21.927085 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:21.927095 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:21.927158 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:21.927309 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:21.927888 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:21.929190 (+ 1302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:21.929974 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:21.930364 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:21.930466 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:21.932918 (+ 2452us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:21.932922 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:21.932922 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:21.932934 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:21.934727 (+ 1793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:21.935126 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:21.935129 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:21.935130 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:21.935234 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:21.935472 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:21.935473 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:21.935473 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:21.935809 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:21.935961 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:21.936186 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 05:08:21.936323 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
I20260808 05:08:21.938035 21715 catalog_manager.cc:1347] Generated new cluster ID: d65bd892d0884da1966ce1288d574c96
I20260808 05:08:21.938083 21715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:21.949343 21715 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:21.949839 21715 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:21.956585 21715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 59a5e01477b140599cff1df2bbcd8f66: Generated new TSK 0
I20260808 05:08:21.956761 21715 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:21.983798 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35009
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:22.075371 21734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:22.075578 21734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:22.075601 21734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:22.076749 21734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:22.076792 21734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:22.076817 21734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:22.078294 21734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21734
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:22.078518 21734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:22.078727 21734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:22.083395 21746 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:22.083405 21749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:22.083397 21744 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:22.083690 21734 server_base.cc:1034] running on GCE node
I20260808 05:08:22.083885 21734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:22.084093 21734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:22.085249 21734 hybrid_clock.cc:648] HybridClock initialized: now 1786165702085233 us; error 28 us; skew 500 ppm
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.087633 21734 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:22.088030 21734 webserver.cc:460] Webserver started at http://127.12.251.1:34965/ using document root <none> and password file <none>
I20260808 05:08:22.088220 21734 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:22.088267 21734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:22.088398 21734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:22.089429 21734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "790b5207abd843b5a82bc25fc418cb89"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "77d5a865892457cf3b2e83696ed09df9"
server_key_iv: "5a91f857ceaa20840237cfda6b1e2f83"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.089731 21734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "790b5207abd843b5a82bc25fc418cb89"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "77d5a865892457cf3b2e83696ed09df9"
server_key_iv: "5a91f857ceaa20840237cfda6b1e2f83"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.090879 21734 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:22.091508 21759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.091672 21734 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:22.091749 21734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "790b5207abd843b5a82bc25fc418cb89"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "77d5a865892457cf3b2e83696ed09df9"
server_key_iv: "5a91f857ceaa20840237cfda6b1e2f83"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.091802 21734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:22.109887 21734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:22.112054 21734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:22.112167 21734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:22.112370 21734 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:22.112677 21734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:22.112712 21734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.112735 21734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:22.112757 21734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.118244 21734 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:41949
I20260808 05:08:22.118285 21934 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:41949 every 8 connection(s)
I20260808 05:08:22.118659 21734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:22.118873 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 21734
I20260808 05:08:22.118989 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:22.119189 13292 external_mini_cluster.cc:1428] Setting key 5dff824fa30e7de51104a94344fab7d3
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
I20260808 05:08:22.127930 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.119616 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:44259 (local address 127.12.251.62:35009)
0808 05:08:22.119676 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.119677 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.119686 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:22.120617 (+ 931us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.120618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.120631 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.120681 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.121311 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.121869 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.122869 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.123075 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.123131 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.125377 (+ 2246us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:22.125379 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:22.125379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:22.125386 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:22.126636 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.127010 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.127011 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.127012 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.127066 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.127284 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.127285 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.127286 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.127392 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:22.127449 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:22.127734 (+ 285us) server_negotiation.cc:299] Negotiation successful
0808 05:08:22.127835 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:08:22.128064 21938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.119335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35009 (local address 127.12.251.1:44259)
0808 05:08:22.119517 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:22.119567 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:22.120514 (+ 947us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:22.120752 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:22.120756 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:22.121002 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:22.121185 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:22.121189 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.121967 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.121968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:22.122784 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:22.122787 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.123152 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.123154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:22.123279 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.123749 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:22.123758 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:22.125293 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:22.126708 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:22.126716 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:22.126718 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:22.126931 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:22.127121 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:22.127122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:22.127122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:22.127228 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:22.127449 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:22.127456 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:22.127613 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 05:08:22.127702 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:08:22.127850 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260808 05:08:22.128546 21935 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35009
I20260808 05:08:22.128639 21935 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:22.128782 21935 heartbeater.cc:511] Master 127.12.251.62:35009 requested a full tablet report, sending...
I20260808 05:08:22.129256 21644 ts_manager.cc:194] Registered new tserver with Master: 790b5207abd843b5a82bc25fc418cb89 (127.12.251.1:41949)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
I20260808 05:08:22.129993 21644 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:44259
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:22.143782 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35009
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:22.224673 21942 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:22.224862 21942 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:22.224884 21942 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:22.225988 21942 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:22.226022 21942 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:22.226045 21942 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:22.227415 21942 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21942
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:22.227604 21942 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:22.227777 21942 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:22.232695 21949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:22.232762 21948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:22.232795 21954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:22.232864 21942 server_base.cc:1034] running on GCE node
I20260808 05:08:22.233119 21942 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:22.233336 21942 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:22.234485 21942 hybrid_clock.cc:648] HybridClock initialized: now 1786165702234469 us; error 31 us; skew 500 ppm
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.236886 21942 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:22.237354 21942 webserver.cc:460] Webserver started at http://127.12.251.2:34881/ using document root <none> and password file <none>
I20260808 05:08:22.237569 21942 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:22.237618 21942 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:22.237746 21942 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:22.238758 21942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "3443475dd33c4e48a68c1dda256c88e0"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "e2e33c88dc2921cf432624bbd657e650"
server_key_iv: "d993787a1e106c82730355d1d6a9b482"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.239095 21942 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "3443475dd33c4e48a68c1dda256c88e0"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "e2e33c88dc2921cf432624bbd657e650"
server_key_iv: "d993787a1e106c82730355d1d6a9b482"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.240392 21942 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:22.241035 21963 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.241186 21942 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:22.241295 21942 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "3443475dd33c4e48a68c1dda256c88e0"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "e2e33c88dc2921cf432624bbd657e650"
server_key_iv: "d993787a1e106c82730355d1d6a9b482"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.241361 21942 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:22.266691 21942 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:22.268411 21942 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:22.268548 21942 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:22.268775 21942 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:22.269078 21942 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:22.269112 21942 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.269140 21942 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:22.269160 21942 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.274509 21942 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:35903
I20260808 05:08:22.274567 22125 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:35903 every 8 connection(s)
I20260808 05:08:22.274847 21942 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:22.278934 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 21942
I20260808 05:08:22.279028 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:22.279196 13292 external_mini_cluster.cc:1428] Setting key c8c916a2f6030be5690c0e91fc7dcc7a
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:22.283777 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.275481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:34123 (local address 127.12.251.62:35009)
0808 05:08:22.275541 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.275543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.275746 (+ 203us) server_negotiation.cc:407] Connection header received
0808 05:08:22.276675 (+ 929us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.276677 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.276690 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.276742 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.277378 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.277880 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.278839 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.279049 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.279112 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.281211 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:22.281228 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:22.281229 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:22.281236 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:22.282495 (+ 1259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.282853 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.282854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.282854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.282910 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.283122 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.283123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.283124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.283235 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:22.283290 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:22.283605 (+ 315us) server_negotiation.cc:299] Negotiation successful
0808 05:08:22.283688 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:08:22.283926 22131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.275449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35009 (local address 127.12.251.2:34123)
0808 05:08:22.275632 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:22.275668 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:22.276571 (+ 903us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:22.276809 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:22.276814 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:22.277066 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:22.277287 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:22.277292 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.277965 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.277966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:22.278751 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:22.278754 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.279131 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.279132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:22.279241 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.279724 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:22.279731 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:22.281119 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:22.282571 (+ 1452us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:22.282578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:22.282580 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:22.282786 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:22.282963 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:22.282964 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:22.282964 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:22.283067 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:22.283289 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:22.283296 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:22.283475 (+ 179us) client_negotiation.cc:769] Sending connection context
0808 05:08:22.283574 (+ 99us) client_negotiation.cc:240] Negotiation successful
0808 05:08:22.283720 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":107,"threads_started":1}
I20260808 05:08:22.284619 22129 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35009
I20260808 05:08:22.284703 22129 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:22.284875 22129 heartbeater.cc:511] Master 127.12.251.62:35009 requested a full tablet report, sending...
I20260808 05:08:22.285280 21644 ts_manager.cc:194] Registered new tserver with Master: 3443475dd33c4e48a68c1dda256c88e0 (127.12.251.2:35903)
I20260808 05:08:22.285774 21644 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:34123
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:22.303956 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35009
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35851
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:22.385586 22135 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:22.385780 22135 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:22.385803 22135 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:22.386912 22135 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:22.386950 22135 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:22.386973 22135 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:22.388420 22135 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35851
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35009
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22135
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:22.388612 22135 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:22.388793 22135 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:08:22.393654 22135 server_base.cc:1034] running on GCE node
W20260808 05:08:22.393618 22143 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:22.393618 22141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:22.393630 22145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:22.394022 22135 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:22.394258 22135 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:22.395416 22135 hybrid_clock.cc:648] HybridClock initialized: now 1786165702395399 us; error 31 us; skew 500 ppm
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.397866 22135 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:22.398334 22135 webserver.cc:460] Webserver started at http://127.12.251.3:38775/ using document root <none> and password file <none>
I20260808 05:08:22.398561 22135 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:22.398609 22135 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:22.398738 22135 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:22.399773 22135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "a0cc0e44fb5644c8bcda02f988933b6e"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "1fec5379bbfcf7ef9bfb34fec73d4936"
server_key_iv: "1ec4ce86cb808ec848ba90e041008c38"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.400112 22135 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "a0cc0e44fb5644c8bcda02f988933b6e"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "1fec5379bbfcf7ef9bfb34fec73d4936"
server_key_iv: "1ec4ce86cb808ec848ba90e041008c38"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.401356 22135 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:08:22.402011 22154 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.402160 22135 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.402236 22135 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "a0cc0e44fb5644c8bcda02f988933b6e"
format_stamp: "Formatted at 2026-08-08 05:08:22 on dist-test-slave-bndk"
server_key: "1fec5379bbfcf7ef9bfb34fec73d4936"
server_key_iv: "1ec4ce86cb808ec848ba90e041008c38"
server_key_version: "encryptionkey@0"
I20260808 05:08:22.402324 22135 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:22.420415 22135 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:22.422292 22135 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:22.422420 22135 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:22.422626 22135 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:22.422892 22135 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:22.422925 22135 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.422966 22135 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:22.422992 22135 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:22.428342 22135 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:37591
I20260808 05:08:22.428375 22332 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:37591 every 8 connection(s)
I20260808 05:08:22.428658 22135 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:22.437245 21702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.429307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:53389 (local address 127.12.251.62:35009)
0808 05:08:22.429362 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.429364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.429610 (+ 246us) server_negotiation.cc:407] Connection header received
0808 05:08:22.430460 (+ 850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.430462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.430472 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.430530 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.431064 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.431586 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.432501 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.432683 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.432727 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.434711 (+ 1984us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:22.434712 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:22.434712 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:22.434719 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:22.436055 (+ 1336us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.436411 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.436412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.436413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.436481 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.436716 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.436717 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.436717 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.436834 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:22.436885 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:22.437094 (+ 209us) server_negotiation.cc:299] Negotiation successful
0808 05:08:22.437157 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:22.437394 22339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.429328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35009 (local address 127.12.251.3:53389)
0808 05:08:22.429499 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:22.429533 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:22.430379 (+ 846us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:22.430586 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:22.430589 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:22.430815 (+ 226us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:22.430990 (+ 175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:22.430994 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.431652 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.431652 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:22.432428 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:22.432431 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.432736 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.432737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:22.432829 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.433201 (+ 372us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:22.433209 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:22.434606 (+ 1397us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:22.436127 (+ 1521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:22.436134 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:22.436136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:22.436345 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:22.436550 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:22.436551 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:22.436551 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:22.436656 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:22.436880 (+ 224us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:22.436883 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:22.436995 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 05:08:22.437070 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:08:22.437186 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":88,"threads_started":1}
I20260808 05:08:22.437863 22334 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35009
I20260808 05:08:22.437953 22334 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:22.438123 22334 heartbeater.cc:511] Master 127.12.251.62:35009 requested a full tablet report, sending...
I20260808 05:08:22.438465 21644 ts_manager.cc:194] Registered new tserver with Master: a0cc0e44fb5644c8bcda02f988933b6e (127.12.251.3:37591)
I20260808 05:08:22.438520 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 22135
I20260808 05:08:22.438581 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:22.438728 13292 external_mini_cluster.cc:1428] Setting key 35c6795391d6ddc5b1d11ed4ed17631c
I20260808 05:08:22.438902 21644 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:53389
I20260808 05:08:22.439564 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/test-admin.keytab.
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.454743 13292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260808 05:08:22.456193 22347 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:22.455498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50728 (local address 127.12.251.1:41949)
0808 05:08:22.455647 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.455651 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.455661 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:22.455683 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.455684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.455697 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.455760 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.456113 (+ 353us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50728: BlockingRecv error: recv got EOF from 127.0.0.1:50728 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
W20260808 05:08:22.456243 13292 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5cc' of type FILE
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.457119 13292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.457934 13292 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:22.464812 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.458385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50744 (local address 127.12.251.1:41949)
0808 05:08:22.458432 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.458434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.458444 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:22.458517 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.458518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.458529 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.458578 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.458940 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.459646 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.460342 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.460653 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.460709 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.462605 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:22.462614 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:22.462614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:22.462622 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:22.463787 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.464092 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.464095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.464096 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.464151 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.464310 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.464310 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.464311 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.464437 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:22.464561 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:22.464636 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 05:08:22.464709 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 05:08:22.466432 22347 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:22.465902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50760 (local address 127.12.251.1:41949)
0808 05:08:22.465949 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.465951 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.465960 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:22.466015 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.466016 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.466023 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.466068 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.466394 (+ 326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50760: BlockingRecv error: recv got EOF from 127.0.0.1:50760 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260808 05:08:22.466588 13292 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5cc' of type FILE
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.467412 13292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.468158 13292 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:22.474057 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.468583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50772 (local address 127.12.251.1:41949)
0808 05:08:22.468629 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.468631 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.468638 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:22.468692 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.468693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.468702 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.468745 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.469064 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.469574 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.470209 (+ 635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.470407 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.470459 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.472143 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:22.472144 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:22.472145 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:22.472151 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:22.473099 (+ 948us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.473426 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.473427 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.473427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.473476 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.473635 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.473635 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.473636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.473719 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:22.473795 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:22.473896 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 05:08:22.473974 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
W20260808 05:08:22.475354 22347 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:22.474911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50784 (local address 127.12.251.1:41949)
0808 05:08:22.474973 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.474975 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.475005 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:08:22.475048 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.475049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.475056 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.475090 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.475314 (+ 224us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50784: BlockingRecv error: recv got EOF from 127.0.0.1:50784 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
W20260808 05:08:22.475436 13292 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786165676707025-13292-0/krb5kdc/krb5cc' of type FILE
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.476263 13292 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:22.476994 13292 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[21579](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165702, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.1@KRBTEST.COM
I20260808 05:08:22.482743 22347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:22.477475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50792 (local address 127.12.251.1:41949)
0808 05:08:22.477519 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:22.477520 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:22.477566 (+ 46us) server_negotiation.cc:407] Connection header received
0808 05:08:22.477610 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:22.477611 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:22.477617 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:22.477658 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:22.477940 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.478382 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.478996 (+ 614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:22.479158 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:22.479199 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:22.480844 (+ 1645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:22.480845 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:22.480845 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:22.480851 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:22.482027 (+ 1176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.482278 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.482278 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.482279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.482323 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:22.482437 (+ 114us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:22.482437 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:22.482437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:22.482511 (+ 74us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:22.482569 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:22.482641 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 05:08:22.482690 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:08:22.483268 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 21734
I20260808 05:08:22.496887 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 21942
I20260808 05:08:22.505311 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 22135
I20260808 05:08:22.517014 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 21599
2026-08-08T05:08:22Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1943 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[22363](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[22363](info): set up 2 sockets
Aug 08 05:08:22 dist-test-slave-bndk krb5kdc[22363](info): commencing operation
krb5kdc: starting...
W20260808 05:08:23.650595 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.112s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:23 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:23Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab.
Entry for principal oryx/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab.
I20260808 05:08:23.766188 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:35073
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab
--principal=oryx/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:35073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:23.847018 22379 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:23.847213 22379 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:23.847234 22379 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:23.848309 22379 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:23.848344 22379 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:23.848357 22379 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:23.848368 22379 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:23.848385 22379 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:23.849822 22379 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:35073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab
--principal=oryx/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:35073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22379
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:23.850005 22379 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:23.850199 22379 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:23.854836 22389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:23.854893 22392 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:23.854982 22379 server_base.cc:1034] running on GCE node
W20260808 05:08:23.854915 22386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:23.855257 22379 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:23.855525 22379 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:23.856678 22379 hybrid_clock.cc:648] HybridClock initialized: now 1786165703856656 us; error 34 us; skew 500 ppm
Aug 08 05:08:23 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165703, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:23.861874 22379 init.cc:377] Logged in from keytab as oryx/127.12.251.62@KRBTEST.COM (short username oryx)
I20260808 05:08:23.862305 22379 webserver.cc:460] Webserver started at http://127.12.251.62:37113/ using document root <none> and password file <none>
I20260808 05:08:23.862529 22379 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:23.862578 22379 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:23.862705 22379 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:23.863724 22379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "15f1e66e325f414cabdf9cd4897b70b3"
format_stamp: "Formatted at 2026-08-08 05:08:23 on dist-test-slave-bndk"
server_key: "8f5335665d57026aef5b39ddaf444ac8"
server_key_iv: "a07d9c1500bf406f1555bc239b888810"
server_key_version: "encryptionkey@0"
I20260808 05:08:23.864046 22379 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "15f1e66e325f414cabdf9cd4897b70b3"
format_stamp: "Formatted at 2026-08-08 05:08:23 on dist-test-slave-bndk"
server_key: "8f5335665d57026aef5b39ddaf444ac8"
server_key_iv: "a07d9c1500bf406f1555bc239b888810"
server_key_version: "encryptionkey@0"
I20260808 05:08:23.865288 22379 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 05:08:23.865984 22402 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:23.866130 22379 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:23.866214 22379 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "15f1e66e325f414cabdf9cd4897b70b3"
format_stamp: "Formatted at 2026-08-08 05:08:23 on dist-test-slave-bndk"
server_key: "8f5335665d57026aef5b39ddaf444ac8"
server_key_iv: "a07d9c1500bf406f1555bc239b888810"
server_key_version: "encryptionkey@0"
I20260808 05:08:23.866279 22379 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:23.885882 22379 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:23.887496 22379 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:23.887624 22379 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:23.891611 22379 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:35073
I20260808 05:08:23.891649 22483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:35073 every 8 connection(s)
I20260808 05:08:23.891960 22379 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:23.892892 22485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:23.895190 22485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: Bootstrap starting.
I20260808 05:08:23.895751 22485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:23.896023 22485 log.cc:824] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:23.896675 22485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: No bootstrap required, opened a new log
I20260808 05:08:23.898285 22485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } }
I20260808 05:08:23.898423 22485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:23.898445 22485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15f1e66e325f414cabdf9cd4897b70b3, State: Initialized, Role: FOLLOWER
I20260808 05:08:23.898593 22485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } }
I20260808 05:08:23.898656 22485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:23.898686 22485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:23.898732 22485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:23.899495 22485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } }
I20260808 05:08:23.899586 22485 leader_election.cc:302] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15f1e66e325f414cabdf9cd4897b70b3; no voters:
I20260808 05:08:23.899734 22485 leader_election.cc:288] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:23.899766 22488 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:23.899895 22488 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 1 LEADER]: Becoming Leader. State: Replica: 15f1e66e325f414cabdf9cd4897b70b3, State: Running, Role: LEADER
I20260808 05:08:23.899976 22485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:23.899999 22488 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } }
I20260808 05:08:23.900324 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 22379
I20260808 05:08:23.900380 22492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f1e66e325f414cabdf9cd4897b70b3. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } }
I20260808 05:08:23.900440 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:23.900373 22491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } }
I20260808 05:08:23.900461 22492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:23.900465 22491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:23.900631 13292 external_mini_cluster.cc:1428] Setting key a5791f4c777d2840c57113f7856e60e2
I20260808 05:08:23.900674 22500 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:23.901199 22500 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:23.902648 22500 catalog_manager.cc:1347] Generated new cluster ID: a1e5616c1af240538225b16709bd153a
I20260808 05:08:23.902704 22500 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:23.909255 22500 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:23.909857 22500 catalog_manager.cc:1504] Loading token signing keys...
Aug 08 05:08:23 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:23.915378 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:23.901295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46214 (local address 127.12.251.62:35073)
0808 05:08:23.901844 (+ 549us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:23.901853 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:23.905417 (+ 3564us) server_negotiation.cc:407] Connection header received
0808 05:08:23.905526 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:23.905532 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:23.905575 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:23.905702 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:23.906340 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:23.907332 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:23.908067 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:23.908884 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:23.908995 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:23.911941 (+ 2946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:23.911945 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:23.911945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:23.911958 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:23.913869 (+ 1911us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:23.914256 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:23.914258 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:23.914259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:23.914357 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:23.914535 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:23.914536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:23.914536 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:23.914795 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:23.914918 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:23.915020 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 05:08:23.915161 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":499,"thread_start_us":71,"threads_started":1}
I20260808 05:08:23.917819 22500 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: Generated new TSK 0
I20260808 05:08:23.917956 22500 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab.
Entry for principal oryx/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab.
I20260808 05:08:23.949928 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35073
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab
--principal=oryx/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:24.030464 22521 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:24.030664 22521 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:24.030695 22521 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:24.031819 22521 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:24.031859 22521 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:24.031893 22521 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:24.033330 22521 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab
--principal=oryx/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22521
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:24.033566 22521 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:24.033771 22521 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:24.038431 22529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.038439 22531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.038417 22528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.038745 22521 server_base.cc:1034] running on GCE node
I20260808 05:08:24.038923 22521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:24.039131 22521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:24.040264 22521 hybrid_clock.cc:648] HybridClock initialized: now 1786165704040247 us; error 27 us; skew 500 ppm
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:24.042666 22521 init.cc:377] Logged in from keytab as oryx/127.12.251.1@KRBTEST.COM (short username oryx)
I20260808 05:08:24.043059 22521 webserver.cc:460] Webserver started at http://127.12.251.1:36277/ using document root <none> and password file <none>
I20260808 05:08:24.043239 22521 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.043277 22521 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.043367 22521 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:24.044297 22521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "cfa905a84e86452ca57fbc8736a29b36"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "f5548c43baffb5c6895eb2058c756e24"
server_key_iv: "68210eb0adbb84bf7f50dc687f90fe2b"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.044585 22521 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "cfa905a84e86452ca57fbc8736a29b36"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "f5548c43baffb5c6895eb2058c756e24"
server_key_iv: "68210eb0adbb84bf7f50dc687f90fe2b"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.045833 22521 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 05:08:24.046496 22540 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.046663 22521 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.046741 22521 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "cfa905a84e86452ca57fbc8736a29b36"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "f5548c43baffb5c6895eb2058c756e24"
server_key_iv: "68210eb0adbb84bf7f50dc687f90fe2b"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.046793 22521 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.067018 22521 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:24.068918 22521 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:24.069032 22521 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:24.069240 22521 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:24.069535 22521 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:24.069566 22521 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.069591 22521 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:24.069607 22521 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.075043 22521 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:35611
I20260808 05:08:24.075101 22697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:35611 every 8 connection(s)
I20260808 05:08:24.075387 22521 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:24.083575 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.076020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:57631 (local address 127.12.251.62:35073)
0808 05:08:24.076105 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.076107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.076268 (+ 161us) server_negotiation.cc:407] Connection header received
0808 05:08:24.076745 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.076746 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.076756 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.076806 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.077794 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.078304 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.079220 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.079425 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.079472 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.081407 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.081408 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.081408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.081415 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.082529 (+ 1114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.082866 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.082866 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.082867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.082914 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.083101 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.083101 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.083102 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.083193 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.083239 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.083432 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.083507 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:08:24.083699 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.075987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.1:57631)
0808 05:08:24.076153 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.076189 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.076655 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.076862 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.076865 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.077464 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.077681 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.077687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.078379 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.078379 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.079154 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.079156 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.079481 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.079482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.079573 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.079968 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.079975 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.081329 (+ 1354us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.082591 (+ 1262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.082597 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.082598 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.082800 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.082960 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.082961 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.082961 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.083059 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.083234 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.083236 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.083339 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.083411 (+ 72us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.083523 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":88,"threads_started":1}
I20260808 05:08:24.084141 22698 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35073
I20260808 05:08:24.084231 22698 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:24.084398 22698 heartbeater.cc:511] Master 127.12.251.62:35073 requested a full tablet report, sending...
I20260808 05:08:24.084872 22432 ts_manager.cc:194] Registered new tserver with Master: cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1:35611)
I20260808 05:08:24.085251 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 22521
I20260808 05:08:24.085340 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:24.085515 13292 external_mini_cluster.cc:1428] Setting key df7ea66990d59feca374982fa65f440e
I20260808 05:08:24.085525 22432 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:57631
WARNING: no policy specified for oryx/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab.
Entry for principal oryx/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab.
I20260808 05:08:24.109239 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35073
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab
--principal=oryx/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:24.190469 22706 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:24.190666 22706 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:24.190696 22706 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:24.191814 22706 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:24.191854 22706 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:24.191890 22706 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:24.193347 22706 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab
--principal=oryx/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22706
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:24.193585 22706 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:24.193800 22706 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:24.198525 22720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.198612 22717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.198540 22716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.198601 22706 server_base.cc:1034] running on GCE node
I20260808 05:08:24.198901 22706 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:24.199110 22706 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:24.200237 22706 hybrid_clock.cc:648] HybridClock initialized: now 1786165704200225 us; error 27 us; skew 500 ppm
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:24.202678 22706 init.cc:377] Logged in from keytab as oryx/127.12.251.2@KRBTEST.COM (short username oryx)
I20260808 05:08:24.203104 22706 webserver.cc:460] Webserver started at http://127.12.251.2:35293/ using document root <none> and password file <none>
I20260808 05:08:24.203322 22706 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.203370 22706 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.203504 22706 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:24.204515 22706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "0d31de13cd0a4929a3fe6b0783465013"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "32e8c650a77f97376d36d7dd0d028b44"
server_key_iv: "12079b60d36669e3cf69fa884e1c3117"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.204833 22706 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "0d31de13cd0a4929a3fe6b0783465013"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "32e8c650a77f97376d36d7dd0d028b44"
server_key_iv: "12079b60d36669e3cf69fa884e1c3117"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.206108 22706 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:08:24.206954 22732 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.207139 22706 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:24.207233 22706 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "0d31de13cd0a4929a3fe6b0783465013"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "32e8c650a77f97376d36d7dd0d028b44"
server_key_iv: "12079b60d36669e3cf69fa884e1c3117"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.207296 22706 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.235596 22706 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:24.237567 22706 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:24.237703 22706 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:24.237922 22706 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:24.238231 22706 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:24.238267 22706 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.238297 22706 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:24.238322 22706 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.243817 22706 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:33437
I20260808 05:08:24.243939 22896 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:33437 every 8 connection(s)
I20260808 05:08:24.244200 22706 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:24.252614 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.244872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:49631 (local address 127.12.251.62:35073)
0808 05:08:24.244929 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.244930 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.245115 (+ 185us) server_negotiation.cc:407] Connection header received
0808 05:08:24.245657 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.245658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.245668 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.245724 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.246632 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.247132 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.248071 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.248245 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.248286 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.250288 (+ 2002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.250290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.250290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.250298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.251586 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.251922 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.251922 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.251923 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.251968 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.252139 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.252139 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.252140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.252236 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.252281 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.252488 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.252548 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:08:24.252789 22902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.244827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.2:49631)
0808 05:08:24.244996 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.245038 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.245575 (+ 537us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.245783 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.245787 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.246358 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.246558 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.246564 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.247198 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.247198 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.248011 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.248014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.248297 (+ 283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.248298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.248392 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.248811 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.248819 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.250197 (+ 1378us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.251655 (+ 1458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.251661 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.251662 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.251866 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.252014 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.252014 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.252014 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.252100 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.252278 (+ 178us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.252281 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.252390 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.252466 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.252582 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
I20260808 05:08:24.253306 22897 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35073
I20260808 05:08:24.253420 22897 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:24.253607 22897 heartbeater.cc:511] Master 127.12.251.62:35073 requested a full tablet report, sending...
I20260808 05:08:24.253984 22432 ts_manager.cc:194] Registered new tserver with Master: 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2:33437)
I20260808 05:08:24.254094 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 22706
I20260808 05:08:24.254202 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:24.254369 13292 external_mini_cluster.cc:1428] Setting key 18c2ec7a8d55bd1d471cfdf72728a16e
I20260808 05:08:24.254405 22432 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:49631
WARNING: no policy specified for oryx/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab.
Entry for principal oryx/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab.
I20260808 05:08:24.279547 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35073
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab
--principal=oryx/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:24.361649 22905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:24.361843 22905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:24.361864 22905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:24.362923 22905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:24.362957 22905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:24.362982 22905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:24.364352 22905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab
--principal=oryx/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:35073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:24.364548 22905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:24.364729 22905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:24.369506 22921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.369552 22917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.369619 22905 server_base.cc:1034] running on GCE node
W20260808 05:08:24.369689 22911 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.369900 22905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:24.370128 22905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:24.371269 22905 hybrid_clock.cc:648] HybridClock initialized: now 1786165704371250 us; error 34 us; skew 500 ppm
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:24.373822 22905 init.cc:377] Logged in from keytab as oryx/127.12.251.3@KRBTEST.COM (short username oryx)
I20260808 05:08:24.374225 22905 webserver.cc:460] Webserver started at http://127.12.251.3:33127/ using document root <none> and password file <none>
I20260808 05:08:24.374495 22905 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.374548 22905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.374670 22905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:24.375664 22905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "9a9a7d193bd044e6a6759009f015c0b2"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "2eb2b21bde2a64c14b55737a2143d572"
server_key_iv: "02d6af71c4f8d5d8fa4e91374b75fcff"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.375976 22905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "9a9a7d193bd044e6a6759009f015c0b2"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "2eb2b21bde2a64c14b55737a2143d572"
server_key_iv: "02d6af71c4f8d5d8fa4e91374b75fcff"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.377192 22905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:24.377972 22930 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.378129 22905 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:24.378212 22905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "9a9a7d193bd044e6a6759009f015c0b2"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "2eb2b21bde2a64c14b55737a2143d572"
server_key_iv: "02d6af71c4f8d5d8fa4e91374b75fcff"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.378270 22905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.384684 22905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:24.386399 22905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:24.386524 22905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:24.386716 22905 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:24.386983 22905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:24.387017 22905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.387044 22905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:24.387068 22905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.392722 22905 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:46515
I20260808 05:08:24.392760 23080 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:46515 every 8 connection(s)
I20260808 05:08:24.393056 22905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:24.394730 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 22905
I20260808 05:08:24.394817 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:24.394968 13292 external_mini_cluster.cc:1428] Setting key 04989831f4004eeb617f59500b69ff58
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:24.402251 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.393777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:42905 (local address 127.12.251.62:35073)
0808 05:08:24.393839 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.393841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.394041 (+ 200us) server_negotiation.cc:407] Connection header received
0808 05:08:24.394527 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.394528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.394539 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.394659 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.395705 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.396212 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.397194 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.397431 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.397496 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.399593 (+ 2097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.399595 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.399595 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.399603 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.400891 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.401302 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.401304 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.401304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.401361 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.401634 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.401636 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.401636 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.401747 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.401806 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.402079 (+ 273us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.402160 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:08:24.402405 23085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.393732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.3:42905)
0808 05:08:24.393905 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.393948 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.394446 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.394714 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.394718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.395410 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.395608 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.395614 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.396300 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.396301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.397109 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.397112 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.397506 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.397508 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.397642 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.398098 (+ 456us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.398107 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.399500 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.400967 (+ 1467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.400974 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.400976 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.401239 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.401442 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.401443 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.401444 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.401575 (+ 131us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.401806 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.401813 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.401948 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.402041 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.402196 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260808 05:08:24.402832 23082 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35073
I20260808 05:08:24.402920 23082 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:24.403098 23082 heartbeater.cc:511] Master 127.12.251.62:35073 requested a full tablet report, sending...
I20260808 05:08:24.403434 22432 ts_manager.cc:194] Registered new tserver with Master: 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515)
I20260808 05:08:24.403764 22432 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:42905
I20260808 05:08:24.406582 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.251.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.61.keytab.
Entry for principal oryx/127.12.251.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.61.keytab.
I20260808 05:08:24.430171 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:42839
--webserver_interface=127.12.251.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.61.keytab
--principal=oryx/127.12.251.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:35073,127.12.251.61:42839
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:24.511086 23090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:24.511322 23090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:24.511349 23090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:24.512491 23090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:24.512530 23090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:24.512543 23090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:24.512554 23090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:24.512566 23090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:24.514099 23090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:35073,127.12.251.61:42839
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.61.keytab
--principal=oryx/127.12.251.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:42839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.251.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
W20260808 05:08:24.514207 23090 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.251.62:35073,127.12.251.61:42839'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260808 05:08:24.514351 23090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:24.514559 23090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:24.519243 23100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.519346 23097 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.519243 23102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.519466 23090 server_base.cc:1034] running on GCE node
I20260808 05:08:24.519707 23090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:24.519972 23090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:24.521108 23090 hybrid_clock.cc:648] HybridClock initialized: now 1786165704521095 us; error 29 us; skew 500 ppm
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:24.523444 23090 init.cc:377] Logged in from keytab as oryx/127.12.251.61@KRBTEST.COM (short username oryx)
I20260808 05:08:24.523869 23090 webserver.cc:460] Webserver started at http://127.12.251.61:44699/ using document root <none> and password file <none>
I20260808 05:08:24.524081 23090 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.524127 23090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.524255 23090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:24.525310 23090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/instance:
uuid: "f4088adbe03e4be1b6b353431c5795bc"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "de7b48021f63608dca3c84366edacfba"
server_key_iv: "11899ab5dbadcab3da36ab826df1e9ca"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.525671 23090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal/instance:
uuid: "f4088adbe03e4be1b6b353431c5795bc"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "de7b48021f63608dca3c84366edacfba"
server_key_iv: "11899ab5dbadcab3da36ab826df1e9ca"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.526899 23090 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:24.527544 23109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.527686 23090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:24.527768 23090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
uuid: "f4088adbe03e4be1b6b353431c5795bc"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "de7b48021f63608dca3c84366edacfba"
server_key_iv: "11899ab5dbadcab3da36ab826df1e9ca"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.527825 23090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.539125 23090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:24.540740 23090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:24.540867 23090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:24.544549 23090 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.61:42839
I20260808 05:08:24.544579 23177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.61:42839 every 8 connection(s)
I20260808 05:08:24.544881 23090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
I20260808 05:08:24.545809 23178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:24.547220 23178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.61@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:24.554481 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 23090
I20260808 05:08:24.555413 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.547844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46220 (local address 127.12.251.62:35073)
0808 05:08:24.547901 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.547903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.548066 (+ 163us) server_negotiation.cc:407] Connection header received
0808 05:08:24.548507 (+ 441us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.548508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.548517 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.548570 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.549167 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.549689 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.550689 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.550883 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.550929 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.552819 (+ 1890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.552821 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.552821 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.552827 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.554061 (+ 1234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.554415 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.554415 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.554416 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.554462 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.554713 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.554714 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.554714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.554855 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.554909 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.555242 (+ 333us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.555323 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:08:24.555554 23181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.547797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:46220)
0808 05:08:24.547954 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.547993 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.548419 (+ 426us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.548624 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.548627 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.548893 (+ 266us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.549095 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.549101 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.549765 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.549766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.550607 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.550610 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.550940 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.550941 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.551041 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.551438 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.551459 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.552730 (+ 1271us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.554129 (+ 1399us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.554134 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.554136 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.554349 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.554520 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.554521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.554521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.554653 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.554924 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.554930 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.555098 (+ 168us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.555205 (+ 107us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.555350 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260808 05:08:24.556138 23178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.61@KRBTEST.COM for oryx/127.12.251.61@KRBTEST.COM
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.251.61@KRBTEST.COM
I20260808 05:08:24.562182 23181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.556350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.0.0.1:34898)
0808 05:08:24.556388 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.556397 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.556431 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.556622 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.556623 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.556743 (+ 120us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.556779 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.556781 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.557402 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.557403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.557869 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.557871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.558194 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.558195 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.558253 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.558508 (+ 255us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.558511 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.559675 (+ 1164us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.561204 (+ 1529us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.561205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.561205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.561402 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.561612 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.561613 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.561613 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.561677 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.561972 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.561973 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.562004 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.562049 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.562123 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 05:08:24.562320 23184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.556405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34898 (local address 127.12.251.61:42839)
0808 05:08:24.556538 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.556540 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.556544 (+ 4us) server_negotiation.cc:407] Connection header received
0808 05:08:24.556555 (+ 11us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.556555 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.556561 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.556608 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.556839 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.557345 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.557934 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.558141 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.558191 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.559745 (+ 1554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.559752 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.559752 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.559759 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.561133 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.561480 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.561484 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.561484 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.561543 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.561735 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.561736 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.561737 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.561903 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.562001 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.562082 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.562221 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":119,"thread_start_us":96,"threads_started":1}
I20260808 05:08:24.563326 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.555021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34888 (local address 127.12.251.61:42839)
0808 05:08:24.555167 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.555172 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.555249 (+ 77us) server_negotiation.cc:407] Connection header received
0808 05:08:24.555288 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.555291 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.555304 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.555364 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.556026 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.556818 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.557553 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.557860 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.557918 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.560309 (+ 2391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.560310 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.560311 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.560316 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.562250 (+ 1934us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.562617 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.562618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.562618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.562674 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.562835 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.562836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.562836 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.562934 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.563060 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.563130 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.563203 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":69,"threads_started":1}
I20260808 05:08:24.563687 23178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Bootstrap starting.
I20260808 05:08:24.564244 23178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:24.564467 23178 log.cc:824] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:24.565115 23178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: No bootstrap required, opened a new log
I20260808 05:08:24.566567 23178 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } }
I20260808 05:08:24.566682 23178 raft_consensus.cc:374] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:24.566702 23178 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4088adbe03e4be1b6b353431c5795bc, State: Initialized, Role: FOLLOWER
I20260808 05:08:24.566817 23178 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } }
I20260808 05:08:24.567049 23187 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } } }
I20260808 05:08:24.567098 23178 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:24.567139 23187 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:08:24.568794 23202 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:08:24.568850 23202 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:08:24.570391 23090 master_runner.cc:428] Detected that this master f4088adbe03e4be1b6b353431c5795bc is joining an existing cluster
I20260808 05:08:24.570464 23090 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.251.61:42839
I20260808 05:08:24.577821 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.571408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46234 (local address 127.12.251.62:35073)
0808 05:08:24.571451 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.571453 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.571586 (+ 133us) server_negotiation.cc:407] Connection header received
0808 05:08:24.571645 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.571647 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.571659 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.571714 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.572201 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.572923 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.573680 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.573879 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.573932 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.574951 (+ 1019us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.574953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.574953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.574960 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.576613 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.577012 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.577014 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.577014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.577078 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.577315 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.577316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.577317 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.577451 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.577520 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.577665 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.577735 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:24.577838 23211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.571356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:46234)
0808 05:08:24.571524 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.571535 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.571595 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.571760 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.571762 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.572015 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.572098 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.572100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.572986 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.572986 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.573608 (+ 622us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.573610 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.573937 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.573938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.574003 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.574425 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.574429 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.574861 (+ 432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.576704 (+ 1843us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.576706 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.576706 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.576935 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.577148 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.577148 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.577149 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.577212 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.577521 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.577522 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.577566 (+ 44us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.577628 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.577720 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":5,"thread_start_us":77,"threads_started":1}
I20260808 05:08:24.578380 23212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.571403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.0.0.1:34910)
0808 05:08:24.571671 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.571677 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.571711 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.571807 (+ 96us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.571808 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.572018 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.572082 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.572083 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.572937 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.572938 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.573916 (+ 978us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.573919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.574375 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.574375 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.574428 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.574762 (+ 334us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.574767 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.575064 (+ 297us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.577352 (+ 2288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.577353 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.577353 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.577485 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.577709 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.577710 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.577710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.577763 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.578043 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.578044 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.578111 (+ 67us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.578176 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.578279 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":258,"mutex_wait_us":24,"thread_start_us":68,"threads_started":1}
I20260808 05:08:24.578467 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.571537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34910 (local address 127.12.251.61:42839)
0808 05:08:24.571583 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.571584 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.571717 (+ 133us) server_negotiation.cc:407] Connection header received
0808 05:08:24.571752 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.571752 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.571761 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.571804 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.572145 (+ 341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.572858 (+ 713us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.574039 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.574278 (+ 239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.574333 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.575128 (+ 795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.575129 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.575129 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.575135 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.577285 (+ 2150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.577564 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.577566 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.577566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.577639 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.577822 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.577823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.577823 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.577956 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.577996 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.578223 (+ 227us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.578353 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":30}
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165703, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.62@KRBTEST.COM for oryx/127.12.251.61@KRBTEST.COM
I20260808 05:08:24.586932 23183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.580681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34916 (local address 127.12.251.61:42839)
0808 05:08:24.580717 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.580719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.580861 (+ 142us) server_negotiation.cc:407] Connection header received
0808 05:08:24.580932 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.580933 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.580942 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.580987 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.581432 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.581902 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.582631 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.582820 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.582878 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.584690 (+ 1812us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.584692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.584692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.584699 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.585919 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.586243 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.586245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.586245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.586293 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.586463 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.586464 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.586464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.586555 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.586607 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.586766 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.586848 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:24.586961 23213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.580624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.0.0.1:34916)
0808 05:08:24.580764 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.580802 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.580869 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.580990 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.580995 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.581308 (+ 313us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.581364 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.581366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.581972 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.581973 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.582557 (+ 584us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.582559 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.582885 (+ 326us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.582885 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.582964 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.583332 (+ 368us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.583344 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.584614 (+ 1270us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.585990 (+ 1376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.585997 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.585999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.586181 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.586353 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.586354 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.586354 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.586413 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.586610 (+ 197us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.586617 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.586667 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.586736 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.586844 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":88,"threads_started":1}
I20260808 05:08:24.587775 22432 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.251.61:42839: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc"
member_type: NON_VOTER
last_known_addr {
host: "127.12.251.61"
port: 42839
}
attrs {
promote: true
}
}
dest_uuid: "15f1e66e325f414cabdf9cd4897b70b3"
cas_config_opid_index: -1
I20260808 05:08:24.588145 22432 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } }
I20260808 05:08:24.588613 23214 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER f4088adbe03e4be1b6b353431c5795bc (127.12.251.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } }
I20260808 05:08:24.588889 23146 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:24.589740 23214 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.251.61:42839
I20260808 05:08:24.589761 23146 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Refusing update from remote peer 15f1e66e325f414cabdf9cd4897b70b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260808 05:08:24.589890 23214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } }
I20260808 05:08:24.589960 23214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:24.590159 23090 master.cc:537] Master@127.12.251.61:42839 shutting down...
I20260808 05:08:24.590255 23215 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:08:24.590963 22403 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260808 05:08:24.591400 22403 consensus_peers.cc:487] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 -> Peer f4088adbe03e4be1b6b353431c5795bc (127.12.251.61:42839): Couldn't send request to peer f4088adbe03e4be1b6b353431c5795bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:08:24.592834 23090 raft_consensus.cc:2229] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:24.592923 23090 raft_consensus.cc:2258] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:24.592975 23090 tablet_replica.cc:330] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: stopping tablet replica
I20260808 05:08:24.605633 23090 master.cc:552] Master@127.12.251.61:42839 shutdown complete.
I20260808 05:08:24.605680 23090 master_runner.cc:305] Clearing existing system tablet
I20260808 05:08:24.605799 23090 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.605841 23090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.606419 23090 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:24.606884 23221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.607029 23090 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.607087 23090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.607111 23090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
uuid: "f4088adbe03e4be1b6b353431c5795bc"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "de7b48021f63608dca3c84366edacfba"
server_key_iv: "11899ab5dbadcab3da36ab826df1e9ca"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.607815 23090 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:24.609159 23090 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 05:08:24.609311 23090 log.cc:1196] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260808 05:08:24.609560 23090 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Deleting consensus metadata
I20260808 05:08:24.609674 23090 master_runner.cc:315] Copying system tablet from 127.12.251.62:35073
I20260808 05:08:24.610221 23090 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: tablet copy: Beginning tablet copy session from remote peer at address 127.12.251.62:35073
I20260808 05:08:24.616325 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.610642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46238 (local address 127.12.251.62:35073)
0808 05:08:24.610690 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.610692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.610736 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:08:24.610821 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.610822 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.610833 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.610881 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.611178 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.611982 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.612660 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.612978 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.613039 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.613964 (+ 925us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.613966 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.613966 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.613973 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.615299 (+ 1326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.615621 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.615622 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.615622 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.615682 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.615844 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.615845 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.615845 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.615957 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.616021 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.616148 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.616229 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:08:24.616343 23232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.610570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:46238)
0808 05:08:24.610676 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.610687 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.610749 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.610898 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.610899 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.611062 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.611117 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.611119 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.612056 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.612057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.612592 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.612593 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.613045 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.613046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.613090 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.613562 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.613566 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.613882 (+ 316us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.615375 (+ 1493us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.615376 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.615377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.615557 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.615736 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.615737 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.615737 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.615794 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.616011 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.616012 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.616057 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.616120 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.616231 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"thread_start_us":67,"threads_started":1}
I20260808 05:08:24.616806 22463 tablet_copy_service.cc:140] P 15f1e66e325f414cabdf9cd4897b70b3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer f4088adbe03e4be1b6b353431c5795bc ({username='oryx', principal='oryx/127.12.251.61@KRBTEST.COM'} at 127.0.0.1:46238)
I20260808 05:08:24.616940 22463 tablet_copy_service.cc:161] P 15f1e66e325f414cabdf9cd4897b70b3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer f4088adbe03e4be1b6b353431c5795bc at {username='oryx', principal='oryx/127.12.251.61@KRBTEST.COM'} at 127.0.0.1:46238: session id = f4088adbe03e4be1b6b353431c5795bc-00000000000000000000000000000000
I20260808 05:08:24.617738 22463 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 05:08:24.618312 23090 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 05:08:24.619300 23090 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: tablet copy: Starting download of 0 data blocks...
I20260808 05:08:24.619429 23090 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: tablet copy: Starting download of 1 WAL segments...
I20260808 05:08:24.620286 23090 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 05:08:24.621040 22463 tablet_copy_service.cc:342] P 15f1e66e325f414cabdf9cd4897b70b3: Request end of tablet copy session f4088adbe03e4be1b6b353431c5795bc-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.251.61@KRBTEST.COM'} at 127.0.0.1:46238
I20260808 05:08:24.621094 22463 tablet_copy_service.cc:433] P 15f1e66e325f414cabdf9cd4897b70b3: ending tablet copy session f4088adbe03e4be1b6b353431c5795bc-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer f4088adbe03e4be1b6b353431c5795bc
I20260808 05:08:24.623399 23090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:24.624491 23235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.624591 23234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.624657 23237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.625031 23090 server_base.cc:1034] running on GCE node
I20260808 05:08:24.625140 23090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:24.625290 23090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:24.626400 23090 hybrid_clock.cc:648] HybridClock initialized: now 1786165704626394 us; error 24 us; skew 500 ppm
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:24.627789 23090 init.cc:377] Logged in from keytab as oryx/127.12.251.61@KRBTEST.COM (short username oryx)
I20260808 05:08:24.628043 23090 webserver.cc:460] Webserver started at http://127.12.251.61:33271/ using document root <none> and password file <none>
I20260808 05:08:24.628152 23090 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.628180 23090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.628713 23090 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:24.629168 23249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.629316 23090 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.629376 23090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
uuid: "f4088adbe03e4be1b6b353431c5795bc"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "de7b48021f63608dca3c84366edacfba"
server_key_iv: "11899ab5dbadcab3da36ab826df1e9ca"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.629433 23090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.644945 23090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:24.646433 23090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:24.649556 23090 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.61:42839
I20260808 05:08:24.649844 23319 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.61:42839 every 8 connection(s)
I20260808 05:08:24.649971 23090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
I20260808 05:08:24.650738 23323 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:08:24.651136 23323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Bootstrap starting.
I20260808 05:08:24.653795 23323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:08:24.653996 23323 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Bootstrap complete.
I20260808 05:08:24.654173 23323 raft_consensus.cc:348] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } }
I20260808 05:08:24.654240 23323 raft_consensus.cc:729] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: f4088adbe03e4be1b6b353431c5795bc, State: Initialized, Role: LEARNER
I20260808 05:08:24.654275 23323 consensus_queue.cc:260] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } }
I20260808 05:08:24.654459 23323 sys_catalog.cc:564] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:24.654457 23328 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } }
I20260808 05:08:24.654548 23328 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: LEARNER
I20260808 05:08:24.655802 23342 catalog_manager.cc:1259] Loaded cluster ID: a1e5616c1af240538225b16709bd153a
I20260808 05:08:24.655843 23342 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: loading cluster ID for follower catalog manager: success
I20260808 05:08:24.656715 23342 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: acquiring CA information for follower catalog manager: success
I20260808 05:08:24.656967 23342 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:08:24.671351 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.664853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34934 (local address 127.12.251.61:42839)
0808 05:08:24.664964 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.664967 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.664977 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:24.665002 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.665003 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.665014 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.665085 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.665632 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.666621 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.667285 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.667579 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.667649 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.668710 (+ 1061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.668711 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.668711 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.668718 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.670324 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.670629 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.670630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.670630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.670693 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.670845 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.670846 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.670846 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.670977 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.671072 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.671136 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.671214 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92,"thread_start_us":57,"threads_started":1}
WARNING: no policy specified for oryx/127.12.251.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.60.keytab.
Entry for principal oryx/127.12.251.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.60.keytab.
I20260808 05:08:24.696633 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:42731
--webserver_interface=127.12.251.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.60.keytab
--principal=oryx/127.12.251.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:24.779438 23348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:24.779652 23348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:24.779673 23348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:24.780841 23348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:24.780884 23348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:24.780901 23348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:24.780925 23348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:24.780946 23348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:24.782503 23348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.60.keytab
--principal=oryx/127.12.251.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:42731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.251.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:24.782738 23348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:24.782949 23348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:24.787514 23356 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.787524 23358 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.787531 23354 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.787791 23348 server_base.cc:1034] running on GCE node
I20260808 05:08:24.788002 23348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:24.788303 23348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:24.789433 23348 hybrid_clock.cc:648] HybridClock initialized: now 1786165704789416 us; error 26 us; skew 500 ppm
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:24.791744 23348 init.cc:377] Logged in from keytab as oryx/127.12.251.60@KRBTEST.COM (short username oryx)
I20260808 05:08:24.792146 23348 webserver.cc:460] Webserver started at http://127.12.251.60:37053/ using document root <none> and password file <none>
I20260808 05:08:24.792336 23348 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.792382 23348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.792508 23348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:24.793536 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/instance:
uuid: "5439fbeb51ff4c2aaea1b7dea892472b"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "28511069d0744683bc7adec76963f1d2"
server_key_iv: "a86ce8efdfe3a75e1f2c59e3f2fc3ca0"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.793859 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal/instance:
uuid: "5439fbeb51ff4c2aaea1b7dea892472b"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "28511069d0744683bc7adec76963f1d2"
server_key_iv: "a86ce8efdfe3a75e1f2c59e3f2fc3ca0"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.795053 23348 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:24.795681 23370 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.795832 23348 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:24.795913 23348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
uuid: "5439fbeb51ff4c2aaea1b7dea892472b"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "28511069d0744683bc7adec76963f1d2"
server_key_iv: "a86ce8efdfe3a75e1f2c59e3f2fc3ca0"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.795979 23348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.816784 23348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:24.818488 23348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:24.818594 23348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:24.822530 23348 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.60:42731
I20260808 05:08:24.822572 23445 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.60:42731 every 8 connection(s)
I20260808 05:08:24.822870 23348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
I20260808 05:08:24.823763 23446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:24.825307 23446 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.60@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:24.831705 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 23348
I20260808 05:08:24.833479 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.826117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46246 (local address 127.12.251.62:35073)
0808 05:08:24.826185 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.826187 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.826242 (+ 55us) server_negotiation.cc:407] Connection header received
0808 05:08:24.826691 (+ 449us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.826692 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.826702 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.826753 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.827296 (+ 543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.827780 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.828680 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.828859 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.828903 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.830871 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.830873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.830873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.830879 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.832159 (+ 1280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.832535 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.832537 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.832537 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.832592 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.832829 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.832829 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.832829 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.832921 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.832966 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.833296 (+ 330us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.833378 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:08:24.833604 23449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.825929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:46246)
0808 05:08:24.826121 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.826173 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.826612 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.826814 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.826818 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.827054 (+ 236us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.827236 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.827240 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.827839 (+ 599us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.827840 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.828619 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.828621 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.828919 (+ 298us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.828919 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.829027 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.829439 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.829448 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.830790 (+ 1342us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.832239 (+ 1449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.832244 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.832246 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.832479 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.832645 (+ 166us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.832645 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.832646 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.832773 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.832985 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.832990 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.833141 (+ 151us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.833257 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.833402 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":107,"threads_started":1}
I20260808 05:08:24.834096 23446 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165703, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.251.60@KRBTEST.COM
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.60@KRBTEST.COM for oryx/127.12.251.61@KRBTEST.COM
I20260808 05:08:24.840624 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.834398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34942 (local address 127.12.251.61:42839)
0808 05:08:24.834440 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.834442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.834463 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:08:24.834489 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.834490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.834500 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.834536 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.834794 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.835469 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.836387 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.836577 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.836627 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.838287 (+ 1660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.838289 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.838289 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.838295 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.839517 (+ 1222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.839865 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.839866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.839867 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.839924 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.840108 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.840109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.840109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.840240 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.840311 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.840448 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.840531 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:24.840613 23449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.834313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.0.0.1:34942)
0808 05:08:24.834377 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.834387 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.834426 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.834553 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.834554 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.834684 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.834733 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.834734 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.835559 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.835560 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.836306 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.836309 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.836641 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.836642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.836718 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.837036 (+ 318us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.837039 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.838220 (+ 1181us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.839597 (+ 1377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.839598 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.839598 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.839793 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.840001 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.840001 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.840002 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.840054 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.840302 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.840303 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.840343 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.840411 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.840507 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 05:08:24.841008 23450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.832214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39798 (local address 127.12.251.60:42731)
0808 05:08:24.832366 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.832370 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.832384 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:08:24.832402 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.832403 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.832413 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.832470 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.833130 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.833986 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.834900 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.835329 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.835397 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.837868 (+ 2471us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.837875 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.837875 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.837880 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.839497 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.839872 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.839875 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.839875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.839924 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.840108 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.840109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.840109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.840266 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.840390 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.840465 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.840559 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":124,"thread_start_us":85,"threads_started":1}
I20260808 05:08:24.840987 23446 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.60@KRBTEST.COM for oryx/127.12.251.60@KRBTEST.COM
I20260808 05:08:24.845968 23449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.841192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.0.0.1:39810)
0808 05:08:24.841247 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.841258 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.841292 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.841463 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.841464 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.841585 (+ 121us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.841617 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.841618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.842176 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.842177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.842607 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.842608 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.842889 (+ 281us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.842889 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.842920 (+ 31us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.843191 (+ 271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.843195 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.844155 (+ 960us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.845286 (+ 1131us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.845287 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.845288 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.845436 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.845572 (+ 136us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.845573 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.845573 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.845617 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.845762 (+ 145us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.845763 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.845791 (+ 28us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.845833 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.845896 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 05:08:24.846036 23450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.841352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39810 (local address 127.12.251.60:42731)
0808 05:08:24.841380 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.841382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.841387 (+ 5us) server_negotiation.cc:407] Connection header received
0808 05:08:24.841400 (+ 13us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.841401 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.841407 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.841447 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.841685 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.842118 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.842658 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.842844 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.842886 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.844221 (+ 1335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.844223 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.844223 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.844228 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.845189 (+ 961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.845488 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.845488 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.845488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.845530 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.845649 (+ 119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.845650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.845650 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.845726 (+ 76us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.845766 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.845847 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.845936 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":14}
I20260808 05:08:24.847110 23446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Bootstrap starting.
I20260808 05:08:24.847898 23446 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:24.848168 23446 log.cc:824] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:24.848855 23446 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: No bootstrap required, opened a new log
I20260808 05:08:24.850350 23446 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } }
I20260808 05:08:24.850467 23446 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:24.850499 23446 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5439fbeb51ff4c2aaea1b7dea892472b, State: Initialized, Role: FOLLOWER
I20260808 05:08:24.850615 23446 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } }
I20260808 05:08:24.850889 23446 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:24.850847 23456 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } } }
I20260808 05:08:24.850943 23456 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:08:24.852626 23469 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:08:24.852682 23469 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:08:24.854627 23348 master_runner.cc:428] Detected that this master 5439fbeb51ff4c2aaea1b7dea892472b is joining an existing cluster
I20260808 05:08:24.854686 23348 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.251.60:42731
I20260808 05:08:24.861713 23450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.855960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39812 (local address 127.12.251.60:42731)
0808 05:08:24.855991 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.855992 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.856000 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:24.856018 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.856019 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.856027 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.856093 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.856529 (+ 436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.857159 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.858157 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.858428 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.858459 (+ 31us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.859535 (+ 1076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.859536 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.859537 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.859543 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.860720 (+ 1177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.860998 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.860999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.860999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.861047 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.861196 (+ 149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.861197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.861197 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.861323 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.861376 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.861515 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.861636 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":16}
I20260808 05:08:24.861874 23476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.855745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.0.0.1:39812)
0808 05:08:24.855897 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.855906 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.855952 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.856096 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.856097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.856253 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.856443 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.856445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.857263 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.857263 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.858076 (+ 813us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.858078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.858536 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.858536 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.858588 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.858990 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.858995 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.859441 (+ 446us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.860789 (+ 1348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.860790 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.860791 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.860941 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.861096 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.861096 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.861097 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.861149 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.861375 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.861376 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.861431 (+ 55us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.861487 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.861587 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":101,"threads_started":1}
I20260808 05:08:24.876159 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.855764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34956 (local address 127.12.251.61:42839)
0808 05:08:24.855813 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.855815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.856474 (+ 659us) server_negotiation.cc:407] Connection header received
0808 05:08:24.856564 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.856565 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.856573 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.856600 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.857001 (+ 401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.857700 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.858736 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.859015 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.859056 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.873630 (+ 14574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.873632 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.873632 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.873640 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.875050 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.875420 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.875421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.875422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.875487 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.875675 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.875675 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.875676 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.875801 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.875860 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.875983 (+ 123us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.876058 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:08:24.876183 23477 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.855764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.0.0.1:34956)
0808 05:08:24.856411 (+ 647us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.856421 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.856499 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.856654 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.856655 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.856859 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.856911 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.856912 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.857786 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.857787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.858643 (+ 856us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.858645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.859130 (+ 485us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.859131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.859205 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.859582 (+ 377us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.859586 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.873508 (+ 13922us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.875139 (+ 1631us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.875140 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.875140 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.875345 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.875554 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.875555 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.875555 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.875616 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.875856 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.875856 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.875898 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.875955 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.876059 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":85,"threads_started":1}
I20260808 05:08:24.877177 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.856265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46262 (local address 127.12.251.62:35073)
0808 05:08:24.856304 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.856306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.856561 (+ 255us) server_negotiation.cc:407] Connection header received
0808 05:08:24.856678 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.856680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.856691 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.856718 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.857162 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.857944 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.859009 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.859301 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.859339 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.874345 (+ 15006us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.874347 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.874347 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.874355 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.875740 (+ 1385us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.876089 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.876090 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.876091 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.876151 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.876702 (+ 551us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.876703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.876703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.876814 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.876863 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.877030 (+ 167us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.877095 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:24.877242 23479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.856219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:46262)
0808 05:08:24.856498 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.856508 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.856608 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.856776 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.856777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.857004 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.857069 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.857071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.858048 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.858049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.858911 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.858914 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.859409 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.859409 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.859495 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.873908 (+ 14413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.873913 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.874259 (+ 346us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.875804 (+ 1545us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.875805 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.875806 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.875998 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.876564 (+ 566us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.876565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.876565 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.876628 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.876877 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.876878 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.876919 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.877014 (+ 95us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.877118 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":265,"thread_start_us":212,"threads_started":1}
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165703, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.62@KRBTEST.COM for oryx/127.12.251.60@KRBTEST.COM
I20260808 05:08:24.886969 23213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.879021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.0.0.1:39824)
0808 05:08:24.879064 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.879074 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.879109 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.879228 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.879229 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.879364 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.879399 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.879401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.879949 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.879950 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.880512 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.880514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.880815 (+ 301us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.880816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.880898 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.881238 (+ 340us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.881243 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.882612 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.886129 (+ 3517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.886130 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.886130 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.886293 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.886487 (+ 194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.886487 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.886488 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.886532 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.886753 (+ 221us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.886753 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.886785 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.886827 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.886904 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:08:24.887006 23450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.879088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39824 (local address 127.12.251.60:42731)
0808 05:08:24.879136 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.879138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.879145 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:24.879174 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.879175 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.879183 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.879227 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.879460 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.879885 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.880579 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.880761 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.880812 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.882705 (+ 1893us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.882706 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.882706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.882713 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.886054 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.886358 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.886359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.886359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.886415 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.886580 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.886581 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.886581 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.886697 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.886763 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.886850 (+ 87us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.886920 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:08:24.887650 22432 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.251.60:42731: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b"
member_type: NON_VOTER
last_known_addr {
host: "127.12.251.60"
port: 42731
}
attrs {
promote: true
}
}
dest_uuid: "15f1e66e325f414cabdf9cd4897b70b3"
cas_config_opid_index: 5
I20260808 05:08:24.887904 22432 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } }
I20260808 05:08:24.888258 23215 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.888571 23414 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:24.889317 23215 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.251.60:42731
I20260808 05:08:24.889397 23215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.889469 23215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:24.889715 23414 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Refusing update from remote peer 15f1e66e325f414cabdf9cd4897b70b3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 05:08:24.889765 23348 master.cc:537] Master@127.12.251.60:42731 shutting down...
I20260808 05:08:24.890017 23214 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260808 05:08:24.890789 22408 consensus_peers.cc:487] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 -> Peer 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60:42731): Couldn't send request to peer 5439fbeb51ff4c2aaea1b7dea892472b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:08:24.893376 23213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.888309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.0.0.1:34966)
0808 05:08:24.889999 (+ 1690us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.890009 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.890050 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.890247 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.890248 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.890250 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:24.890286 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.890288 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.891161 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.891163 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.892270 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.892273 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.893110 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.893111 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.893177 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.893199 (+ 22us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.893268 (+ 69us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.893312 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1674}
I20260808 05:08:24.893581 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.888410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34966 (local address 127.12.251.61:42839)
0808 05:08:24.888524 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.888526 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.890100 (+ 1574us) server_negotiation.cc:407] Connection header received
0808 05:08:24.890124 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.890125 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.890147 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.890197 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:24.890406 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.891092 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.892357 (+ 1265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.892935 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.892995 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.893076 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.893466 (+ 390us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.893518 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260808 05:08:24.894402 23286 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 LEARNER]: Refusing update from remote peer 15f1e66e325f414cabdf9cd4897b70b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260808 05:08:24.894600 23214 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260808 05:08:24.895210 23286 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.896407 23328 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f1e66e325f414cabdf9cd4897b70b3. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.896499 23328 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: LEARNER
I20260808 05:08:24.896538 23328 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: NON_VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: true } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.896589 23328 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: LEARNER
I20260808 05:08:24.896793 23214 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: attempting to promote NON_VOTER f4088adbe03e4be1b6b353431c5795bc to VOTER
I20260808 05:08:24.896984 23214 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } }
I20260808 05:08:24.897149 23348 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:24.897284 23348 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:24.897337 23348 tablet_replica.cc:330] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: stopping tablet replica
W20260808 05:08:24.897861 22408 consensus_peers.cc:487] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 -> Peer 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60:42731): Couldn't send request to peer 5439fbeb51ff4c2aaea1b7dea892472b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260808 05:08:24.898123 23286 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 LEARNER]: Refusing update from remote peer 15f1e66e325f414cabdf9cd4897b70b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260808 05:08:24.898345 23483 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260808 05:08:24.899138 23214 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f4088adbe03e4be1b6b353431c5795bc (127.12.251.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.899421 23286 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, f4088adbe03e4be1b6b353431c5795bc (127.12.251.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.899919 23214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.900043 23214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:24.900094 23214 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.900142 23214 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:24.900408 23482 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.900511 23482 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:08:24.911192 23348 master.cc:552] Master@127.12.251.60:42731 shutdown complete.
I20260808 05:08:24.911235 23348 master_runner.cc:305] Clearing existing system tablet
I20260808 05:08:24.911361 23348 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.911404 23348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.911957 23348 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:24.912375 23485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.912526 23348 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.912581 23348 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.912604 23348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
uuid: "5439fbeb51ff4c2aaea1b7dea892472b"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "28511069d0744683bc7adec76963f1d2"
server_key_iv: "a86ce8efdfe3a75e1f2c59e3f2fc3ca0"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.913161 23348 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:24.914341 23348 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260808 05:08:24.914397 23348 log.cc:1196] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260808 05:08:24.914585 23348 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Deleting consensus metadata
I20260808 05:08:24.914712 23348 master_runner.cc:315] Copying system tablet from 127.12.251.62:35073
I20260808 05:08:24.915269 23348 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: tablet copy: Beginning tablet copy session from remote peer at address 127.12.251.62:35073
I20260808 05:08:24.921028 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.915604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46266 (local address 127.12.251.62:35073)
0808 05:08:24.915649 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.915651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.915742 (+ 91us) server_negotiation.cc:407] Connection header received
0808 05:08:24.915810 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.915811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.915821 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.915867 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:24.916414 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.916895 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.917663 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.917859 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.917913 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.918773 (+ 860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:24.918775 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:24.918775 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:24.918783 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:24.920025 (+ 1242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.920329 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.920330 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.920330 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.920382 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:24.920553 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:24.920554 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:24.920554 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:24.920658 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:24.920714 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:24.920856 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:08:24.920928 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:08:24.921028 23491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.915560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:46266)
0808 05:08:24.915673 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:24.915684 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:24.915751 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:24.915870 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:24.915871 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:24.916053 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:24.916334 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.916337 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.916966 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.916967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.917588 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:24.917591 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:24.917918 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:24.917919 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:24.917982 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:24.918382 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:24.918387 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:24.918690 (+ 303us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:24.920101 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.920102 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.920103 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.920268 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.920437 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:24.920437 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:24.920438 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:24.920503 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:24.920715 (+ 212us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:24.920716 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:24.920764 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 05:08:24.920823 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:08:24.920929 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":68,"threads_started":1}
I20260808 05:08:24.921471 22463 tablet_copy_service.cc:140] P 15f1e66e325f414cabdf9cd4897b70b3: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 5439fbeb51ff4c2aaea1b7dea892472b ({username='oryx', principal='oryx/127.12.251.60@KRBTEST.COM'} at 127.0.0.1:46266)
I20260808 05:08:24.921540 22463 tablet_copy_service.cc:161] P 15f1e66e325f414cabdf9cd4897b70b3: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 5439fbeb51ff4c2aaea1b7dea892472b at {username='oryx', principal='oryx/127.12.251.60@KRBTEST.COM'} at 127.0.0.1:46266: session id = 5439fbeb51ff4c2aaea1b7dea892472b-00000000000000000000000000000000
I20260808 05:08:24.921958 22463 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: Tablet Copy: opened 0 blocks and 1 log segments
I20260808 05:08:24.922379 23348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260808 05:08:24.923243 23348 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: tablet copy: Starting download of 0 data blocks...
I20260808 05:08:24.923365 23348 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: tablet copy: Starting download of 1 WAL segments...
I20260808 05:08:24.924052 23348 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260808 05:08:24.924854 22463 tablet_copy_service.cc:342] P 15f1e66e325f414cabdf9cd4897b70b3: Request end of tablet copy session 5439fbeb51ff4c2aaea1b7dea892472b-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.251.60@KRBTEST.COM'} at 127.0.0.1:46266
I20260808 05:08:24.924906 22463 tablet_copy_service.cc:433] P 15f1e66e325f414cabdf9cd4897b70b3: ending tablet copy session 5439fbeb51ff4c2aaea1b7dea892472b-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 5439fbeb51ff4c2aaea1b7dea892472b
I20260808 05:08:24.927287 23348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:24.928381 23492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.928434 23493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:24.928442 23495 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:24.928637 23348 server_base.cc:1034] running on GCE node
I20260808 05:08:24.928740 23348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:24.928869 23348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:24.929979 23348 hybrid_clock.cc:648] HybridClock initialized: now 1786165704929969 us; error 25 us; skew 500 ppm
Aug 08 05:08:24 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165704, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:24.931375 23348 init.cc:377] Logged in from keytab as oryx/127.12.251.60@KRBTEST.COM (short username oryx)
I20260808 05:08:24.931633 23348 webserver.cc:460] Webserver started at http://127.12.251.60:34849/ using document root <none> and password file <none>
I20260808 05:08:24.931746 23348 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:24.931777 23348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:24.932301 23348 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:24.932775 23504 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.932874 23348 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:24.932919 23348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
uuid: "5439fbeb51ff4c2aaea1b7dea892472b"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "28511069d0744683bc7adec76963f1d2"
server_key_iv: "a86ce8efdfe3a75e1f2c59e3f2fc3ca0"
server_key_version: "encryptionkey@0"
I20260808 05:08:24.932973 23348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:24.954320 23348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:24.956024 23348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:24.959590 23348 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.60:42731
I20260808 05:08:24.959740 23579 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.60:42731 every 8 connection(s)
I20260808 05:08:24.959918 23348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
I20260808 05:08:24.960621 23580 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:08:24.961030 23580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Bootstrap starting.
I20260808 05:08:24.963394 23580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:08:24.963567 23580 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: Bootstrap complete.
I20260808 05:08:24.963774 23580 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } }
I20260808 05:08:24.963850 23580 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 5439fbeb51ff4c2aaea1b7dea892472b, State: Initialized, Role: LEARNER
I20260808 05:08:24.963876 23580 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } }
I20260808 05:08:24.964066 23580 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:24.964046 23586 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:24.964151 23586 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: This master's current role is: LEARNER
I20260808 05:08:24.965602 23604 catalog_manager.cc:1259] Loaded cluster ID: a1e5616c1af240538225b16709bd153a
I20260808 05:08:24.965687 23604 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: loading cluster ID for follower catalog manager: success
I20260808 05:08:24.966777 23604 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: acquiring CA information for follower catalog manager: success
I20260808 05:08:24.967010 23604 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:08:25.005532 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:24.999706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39840 (local address 127.12.251.60:42731)
0808 05:08:24.999824 (+ 118us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:24.999826 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:24.999835 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:24.999861 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:24.999861 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:24.999871 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:24.999930 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.000448 (+ 518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.001139 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.001917 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.002137 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.002197 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.003252 (+ 1055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.003254 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.003254 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.003260 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.004663 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.004915 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.004916 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.004916 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.004964 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.005085 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.005086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.005086 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.005180 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.005283 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.005353 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.005421 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":64,"threads_started":1}
I20260808 05:08:25.006045 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 22521
I20260808 05:08:25.023947 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:35611
--local_ip_for_outbound_sockets=127.12.251.1
--tserver_master_addrs=127.12.251.62:35073
--webserver_port=36277
--webserver_interface=127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab
--principal=oryx/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:25.105590 23606 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:25.105795 23606 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:25.105819 23606 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:25.106918 23606 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:25.106956 23606 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:25.106979 23606 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:25.108373 23606 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab
--principal=oryx/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:35611
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=36277
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23606
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:25.108561 23606 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:25.108750 23606 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:25.113708 23613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:25.113708 23616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:25.113801 23606 server_base.cc:1034] running on GCE node
W20260808 05:08:25.113718 23612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:25.114140 23606 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:25.114351 23606 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:25.115485 23606 hybrid_clock.cc:648] HybridClock initialized: now 1786165705115467 us; error 33 us; skew 500 ppm
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:25.117916 23606 init.cc:377] Logged in from keytab as oryx/127.12.251.1@KRBTEST.COM (short username oryx)
I20260808 05:08:25.118343 23606 webserver.cc:460] Webserver started at http://127.12.251.1:36277/ using document root <none> and password file <none>
I20260808 05:08:25.118577 23606 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:25.118645 23606 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:25.119918 23606 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:25.120420 23629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.120569 23606 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.120654 23606 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "cfa905a84e86452ca57fbc8736a29b36"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "f5548c43baffb5c6895eb2058c756e24"
server_key_iv: "68210eb0adbb84bf7f50dc687f90fe2b"
server_key_version: "encryptionkey@0"
I20260808 05:08:25.120988 23606 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:25.155043 23606 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:25.157449 23606 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:25.157593 23606 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:25.157823 23606 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:25.158133 23606 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:25.158167 23606 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.158196 23606 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:25.158221 23606 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.163926 23606 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:35611
I20260808 05:08:25.163996 23782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:35611 every 8 connection(s)
I20260808 05:08:25.164324 23606 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:25.169065 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 23606
I20260808 05:08:25.169243 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 22706
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:25.178894 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.165541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:39355 (local address 127.12.251.62:35073)
0808 05:08:25.165600 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.165601 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.166695 (+ 1094us) server_negotiation.cc:407] Connection header received
0808 05:08:25.166749 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.166750 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.166762 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.166807 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.167544 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.168295 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.170399 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.170763 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.170812 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.174339 (+ 3527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.174341 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.174341 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.174350 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.177316 (+ 2966us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.177826 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.177827 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.177827 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.177888 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.178159 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.178160 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.178160 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.178291 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.178333 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.178711 (+ 378us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.178798 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:08:25.179334 23791 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.165428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.1:39355)
0808 05:08:25.166644 (+ 1216us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.166653 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.166700 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.166817 (+ 117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.166818 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.167133 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.167422 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.167428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.169270 (+ 1842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.169271 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.170280 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.170284 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.170916 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.170917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.171153 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.171937 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.171948 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.174207 (+ 2259us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.177420 (+ 3213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.177429 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.177432 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.177740 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.177950 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.177950 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.177951 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.178085 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.178377 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.178384 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.178542 (+ 158us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.178665 (+ 123us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.178886 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1200,"mutex_wait_us":5,"thread_start_us":132,"threads_started":1}
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.61@KRBTEST.COM
I20260808 05:08:25.181310 23785 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35073
I20260808 05:08:25.181418 23785 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.181609 23785 heartbeater.cc:511] Master 127.12.251.62:35073 requested a full tablet report, sending...
I20260808 05:08:25.182060 22432 ts_manager.cc:194] Re-registered known tserver with Master: cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1:35611)
I20260808 05:08:25.182487 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.165112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:45065 (local address 127.12.251.61:42839)
0808 05:08:25.165170 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.165172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.165661 (+ 489us) server_negotiation.cc:407] Connection header received
0808 05:08:25.166583 (+ 922us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.166584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.166594 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.166645 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.167525 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.168291 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.177994 (+ 9703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.178191 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.178248 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.180072 (+ 1824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.180074 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.180074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.180082 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.181286 (+ 1204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.181619 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.181620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.181621 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.181680 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.181860 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.181860 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.181861 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.182001 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.182061 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.182319 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.182398 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:08:25.182529 22432 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:39355
I20260808 05:08:25.182770 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:33437
--local_ip_for_outbound_sockets=127.12.251.2
--tserver_master_addrs=127.12.251.62:35073
--webserver_port=35293
--webserver_interface=127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab
--principal=oryx/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:08:25.182958 23792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.165068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.12.251.1:45065)
0808 05:08:25.165604 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.165614 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.166483 (+ 869us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.166734 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.166739 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.167179 (+ 440us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.167421 (+ 242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.167427 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.168382 (+ 955us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.168382 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.177864 (+ 9482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.177867 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.178252 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.178253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.178315 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.178684 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.178689 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.179998 (+ 1309us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.181360 (+ 1362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.181361 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.181362 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.181557 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.181752 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.181752 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.181753 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.181812 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.182089 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.182090 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.182203 (+ 113us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.182756 (+ 553us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.182842 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":30,"thread_start_us":96,"threads_started":1}
I20260808 05:08:25.183365 23786 heartbeater.cc:347] Connected to a master server at 127.12.251.61:42839
I20260808 05:08:25.183410 23786 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.183481 23786 heartbeater.cc:511] Master 127.12.251.61:42839 requested a full tablet report, sending...
I20260808 05:08:25.183816 23274 ts_manager.cc:194] Registered new tserver with Master: cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1:35611)
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.60@KRBTEST.COM
I20260808 05:08:25.187314 23789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.165067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.12.251.1:56527)
0808 05:08:25.165263 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.165306 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.166464 (+ 1158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.166998 (+ 534us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.166999 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.167210 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.167422 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.167428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.169064 (+ 1636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.169065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.182464 (+ 13399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.182468 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.183005 (+ 537us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.183006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.183119 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.183525 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.183530 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.184867 (+ 1337us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.186437 (+ 1570us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.186438 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.186438 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.186596 (+ 158us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.186801 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.186802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.186802 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.186852 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.187094 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.187094 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.187123 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.187168 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.187243 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":26,"thread_start_us":91,"threads_started":1}
I20260808 05:08:25.187379 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.165059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:56527 (local address 127.12.251.60:42731)
0808 05:08:25.165277 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.165279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.165412 (+ 133us) server_negotiation.cc:407] Connection header received
0808 05:08:25.166571 (+ 1159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.166573 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.166588 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.166648 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.168392 (+ 1744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.168990 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.182575 (+ 13585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.182871 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.182917 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.184971 (+ 2054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.184972 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.184973 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.184981 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.186359 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.186669 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.186670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.186670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.186736 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.186905 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.186906 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.186906 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.187040 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.187106 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.187197 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.187285 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195}
I20260808 05:08:25.187727 23783 heartbeater.cc:347] Connected to a master server at 127.12.251.60:42731
I20260808 05:08:25.187779 23783 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.187835 23783 heartbeater.cc:511] Master 127.12.251.60:42731 requested a full tablet report, sending...
I20260808 05:08:25.188169 23523 ts_manager.cc:194] Registered new tserver with Master: cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1:35611)
W20260808 05:08:25.264593 23793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:25.264816 23793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:25.264847 23793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:25.266072 23793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:25.266114 23793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:25.266150 23793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:25.267867 23793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab
--principal=oryx/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:33437
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=35293
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:25.268110 23793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:25.268390 23793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:25.273413 23798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:25.273530 23802 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:25.273422 23799 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:25.273747 23793 server_base.cc:1034] running on GCE node
I20260808 05:08:25.273949 23793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:25.274190 23793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:25.275328 23793 hybrid_clock.cc:648] HybridClock initialized: now 1786165705275320 us; error 34 us; skew 500 ppm
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:25.277815 23793 init.cc:377] Logged in from keytab as oryx/127.12.251.2@KRBTEST.COM (short username oryx)
I20260808 05:08:25.278230 23793 webserver.cc:460] Webserver started at http://127.12.251.2:35293/ using document root <none> and password file <none>
I20260808 05:08:25.278425 23793 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:25.278486 23793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:25.284524 23793 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s
I20260808 05:08:25.285137 23813 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.285368 23793 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:25.285459 23793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "0d31de13cd0a4929a3fe6b0783465013"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "32e8c650a77f97376d36d7dd0d028b44"
server_key_iv: "12079b60d36669e3cf69fa884e1c3117"
server_key_version: "encryptionkey@0"
I20260808 05:08:25.285884 23793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:25.300895 23793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:25.303022 23793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:25.303160 23793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:25.303390 23793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:25.303721 23793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:25.303757 23793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.303786 23793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:25.303812 23793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.310784 23793 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:33437
I20260808 05:08:25.310863 23969 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:33437 every 8 connection(s)
I20260808 05:08:25.311218 23793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:25.318338 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 23793
I20260808 05:08:25.318476 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 22905
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.61@KRBTEST.COM
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.60@KRBTEST.COM
I20260808 05:08:25.353425 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.312296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:36783 (local address 127.12.251.61:42839)
0808 05:08:25.312336 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.312338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.312347 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:25.312954 (+ 607us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.312955 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.312968 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.313020 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.314242 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.315024 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.316709 (+ 1685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.317042 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.317087 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.350123 (+ 33036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.350126 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.350126 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.350137 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.352040 (+ 1903us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.352396 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.352398 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.352398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.352452 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.352633 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.352634 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.352634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.352770 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.352809 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.353211 (+ 402us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.353318 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:25.353973 23975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.311985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.12.251.2:36783)
0808 05:08:25.312190 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.312233 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.312858 (+ 625us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.313250 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.313256 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.313768 (+ 512us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.314111 (+ 343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.314119 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.315154 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.315155 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.316600 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.316604 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.317183 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.317184 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.317299 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.318166 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.318171 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.350001 (+ 31830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.352104 (+ 2103us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.352105 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.352106 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.352307 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.352518 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.352519 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.352519 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.352573 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.352862 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.352870 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.353060 (+ 190us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.353523 (+ 463us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.353717 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":172,"mutex_wait_us":150,"thread_start_us":128,"threads_started":1}
I20260808 05:08:25.354070 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.311971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:45789 (local address 127.12.251.62:35073)
0808 05:08:25.312026 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.312028 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.312316 (+ 288us) server_negotiation.cc:407] Connection header received
0808 05:08:25.313009 (+ 693us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.313011 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.313023 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.313072 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.314222 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.315000 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.316575 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.316871 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.316911 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.349506 (+ 32595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.349509 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.349509 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.349520 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.351316 (+ 1796us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.351840 (+ 524us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.351841 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.351842 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.351934 (+ 92us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.353316 (+ 1382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.353317 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.353317 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.353496 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.353552 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.353841 (+ 289us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.353959 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:25.354554 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.311984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.2:45789)
0808 05:08:25.312189 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.312233 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.312865 (+ 632us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.313574 (+ 709us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.313574 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.313798 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.314111 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.314117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.315142 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.315143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.316478 (+ 1335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.316480 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.317005 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.317006 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.317158 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.317841 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.317850 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.349331 (+ 31481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.351414 (+ 2083us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.351425 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.351428 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.351746 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.352040 (+ 294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.352042 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.352042 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.352268 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.353611 (+ 1343us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.353612 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.353671 (+ 59us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.354255 (+ 584us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.354393 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":100,"thread_start_us":114,"threads_started":1}
I20260808 05:08:25.355067 23971 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35073
I20260808 05:08:25.355206 23971 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.355507 23971 heartbeater.cc:511] Master 127.12.251.62:35073 requested a full tablet report, sending...
I20260808 05:08:25.356020 22432 ts_manager.cc:194] Re-registered known tserver with Master: 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2:33437)
I20260808 05:08:25.356653 22432 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:45789
I20260808 05:08:25.358259 23972 heartbeater.cc:347] Connected to a master server at 127.12.251.61:42839
I20260808 05:08:25.358305 23972 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.358364 23972 heartbeater.cc:511] Master 127.12.251.61:42839 requested a full tablet report, sending...
I20260808 05:08:25.358608 23274 ts_manager.cc:194] Registered new tserver with Master: 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2:33437)
I20260808 05:08:25.359422 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.312580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:54957 (local address 127.12.251.60:42731)
0808 05:08:25.312626 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.312627 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.312677 (+ 50us) server_negotiation.cc:407] Connection header received
0808 05:08:25.313101 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.313103 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.313115 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.313143 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.314222 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.314995 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.316575 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.316871 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.316911 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.350547 (+ 33636us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.350549 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.350550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.350561 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.353147 (+ 2586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.357989 (+ 4842us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.357992 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.357992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.358065 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.358889 (+ 824us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.358890 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.358891 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.359024 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.359072 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.359245 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.359335 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:08:25.359709 23976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.312513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.12.251.2:54957)
0808 05:08:25.312628 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.312637 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.312866 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.313252 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.313257 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.313798 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.314111 (+ 313us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.314117 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.315142 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.315143 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.316476 (+ 1333us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.316478 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.317003 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.317004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.317158 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.317917 (+ 759us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.317921 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.350412 (+ 32491us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.355862 (+ 5450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.355863 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.355864 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.357851 (+ 1987us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.358766 (+ 915us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.358767 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.358767 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.358825 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.359101 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.359102 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.359141 (+ 39us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.359491 (+ 350us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.359609 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"mutex_wait_us":144,"thread_start_us":76,"threads_started":1}
I20260808 05:08:25.364881 23970 heartbeater.cc:347] Connected to a master server at 127.12.251.60:42731
I20260808 05:08:25.364938 23970 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.364988 23970 heartbeater.cc:511] Master 127.12.251.60:42731 requested a full tablet report, sending...
I20260808 05:08:25.364966 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:46515
--local_ip_for_outbound_sockets=127.12.251.3
--tserver_master_addrs=127.12.251.62:35073
--webserver_port=33127
--webserver_interface=127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab
--principal=oryx/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43675
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:08:25.365299 23523 ts_manager.cc:194] Registered new tserver with Master: 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2:33437)
W20260808 05:08:25.484820 23977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:25.485016 23977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:25.485038 23977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:25.486151 23977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:25.486193 23977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:25.486220 23977 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:25.487633 23977 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43675
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab
--principal=oryx/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:46515
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=33127
--tserver_master_addrs=127.12.251.62:35073,127.12.251.61:42839,127.12.251.60:42731
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23977
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:25.487813 23977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:25.487994 23977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:25.492969 23988 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:25.492924 23990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:25.493057 23977 server_base.cc:1034] running on GCE node
W20260808 05:08:25.492924 23996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:25.493332 23977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:25.493556 23977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:25.494688 23977 hybrid_clock.cc:648] HybridClock initialized: now 1786165705494679 us; error 26 us; skew 500 ppm
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:25.497118 23977 init.cc:377] Logged in from keytab as oryx/127.12.251.3@KRBTEST.COM (short username oryx)
I20260808 05:08:25.497543 23977 webserver.cc:460] Webserver started at http://127.12.251.3:33127/ using document root <none> and password file <none>
I20260808 05:08:25.497754 23977 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:25.497821 23977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:25.499133 23977 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:25.499766 24008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.499922 23977 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:25.500013 23977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "9a9a7d193bd044e6a6759009f015c0b2"
format_stamp: "Formatted at 2026-08-08 05:08:24 on dist-test-slave-bndk"
server_key: "2eb2b21bde2a64c14b55737a2143d572"
server_key_iv: "02d6af71c4f8d5d8fa4e91374b75fcff"
server_key_version: "encryptionkey@0"
I20260808 05:08:25.500355 23977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:25.509526 23977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:25.511530 23977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:25.511664 23977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:25.511864 23977 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:25.512153 23977 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:25.512194 23977 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.512223 23977 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:25.512264 23977 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:25.517242 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.513036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.0.0.1:39848)
0808 05:08:25.513291 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.513301 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.513370 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.513557 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.513557 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.513560 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:25.513623 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.513626 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.514570 (+ 944us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.514572 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.516132 (+ 1560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.516137 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.516943 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.516944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.517022 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.517027 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.517084 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.517137 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":238,"thread_start_us":47,"threads_started":1}
I20260808 05:08:25.517467 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.513118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39848 (local address 127.12.251.60:42731)
0808 05:08:25.513173 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.513175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.513370 (+ 195us) server_negotiation.cc:407] Connection header received
0808 05:08:25.513428 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.513429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.513456 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.513551 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:25.513692 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.514441 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.516255 (+ 1814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.516861 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.516939 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.517027 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.517345 (+ 318us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.517394 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:08:25.517866 23539 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.7] Dedup: 1.7->[]
I20260808 05:08:25.518136 24128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15f1e66e325f414cabdf9cd4897b70b3. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:25.518393 24128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: This master's current role is: LEARNER
I20260808 05:08:25.519733 23977 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:46515
I20260808 05:08:25.519766 24162 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:46515 every 8 connection(s)
I20260808 05:08:25.520104 23977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:25.520718 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 23977
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.60@KRBTEST.COM
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
Aug 08 05:08:25 dist-test-slave-bndk krb5kdc[22363](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165705, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.61@KRBTEST.COM
I20260808 05:08:25.532125 24182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.522118 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46278 (local address 127.12.251.62:35073)
0808 05:08:25.522220 (+ 102us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.522222 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.522629 (+ 407us) server_negotiation.cc:407] Connection header received
0808 05:08:25.522677 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.522678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.522689 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.522750 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.523601 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.524310 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.525337 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.525665 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.525703 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.527186 (+ 1483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.527188 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.527188 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.527194 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.529796 (+ 2602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.530576 (+ 780us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.530577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.530578 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.530646 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.530893 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.530894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.530894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.531582 (+ 688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.531685 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.531883 (+ 198us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.532018 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85,"thread_start_us":46,"threads_started":1}
I20260808 05:08:25.533927 23343 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.521578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:45509 (local address 127.12.251.61:42839)
0808 05:08:25.521623 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.521625 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.522235 (+ 610us) server_negotiation.cc:407] Connection header received
0808 05:08:25.522547 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.522549 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.522561 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.522592 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.523364 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.524136 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.526349 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.526992 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.527060 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.529690 (+ 2630us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.529692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.529692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.529699 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.531538 (+ 1839us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.532749 (+ 1211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.532751 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.532751 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.532811 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533088 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.533089 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.533089 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.533208 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.533288 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.533757 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.533837 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:25.534397 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.521750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:52307 (local address 127.12.251.60:42731)
0808 05:08:25.521787 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.521788 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.522401 (+ 613us) server_negotiation.cc:407] Connection header received
0808 05:08:25.522766 (+ 365us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.522767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.522777 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.522806 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.523393 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.524143 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.525865 (+ 1722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.526125 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.526158 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.530288 (+ 4130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.530290 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.530290 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.530298 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.532271 (+ 1973us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533640 (+ 1369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.533642 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.533642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.533693 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533890 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.533891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.533891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.534031 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.534078 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.534252 (+ 174us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.534317 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:25.534662 24170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.520836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.3:57005)
0808 05:08:25.521015 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.521063 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.521719 (+ 656us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.522060 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.522065 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.523391 (+ 1326us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.523445 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.523447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.524317 (+ 870us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.524318 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.525659 (+ 1341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.525662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.526148 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.526149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.526300 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.527596 (+ 1296us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.527601 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.530124 (+ 2523us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.532542 (+ 2418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.532542 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.532543 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.532953 (+ 410us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.533562 (+ 609us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533563 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.533563 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.533622 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.534041 (+ 419us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.534042 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.534080 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.534358 (+ 278us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.534464 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":37,"thread_start_us":79,"threads_started":1}
I20260808 05:08:25.534854 24179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.521705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.12.251.3:52307)
0808 05:08:25.522335 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.522346 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.522689 (+ 343us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.522859 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.522860 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.523180 (+ 320us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.523303 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.523306 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.524259 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.524260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.525781 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.525783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.526226 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.526227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.526307 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.526826 (+ 519us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.526838 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.529283 (+ 2445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.533319 (+ 4036us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.533321 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.533561 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.533762 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533764 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.533764 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.533816 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.534107 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.534108 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.534139 (+ 31us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.534515 (+ 376us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.534598 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":92,"threads_started":1}
I20260808 05:08:25.535199 24177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.521487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.12.251.3:45509)
0808 05:08:25.521672 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.521681 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.522290 (+ 609us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.522660 (+ 370us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.522660 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.522964 (+ 304us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:25.523264 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.523272 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.524260 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.524261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.525660 (+ 1399us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.525662 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.527114 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.527115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.527177 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.527717 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:25.527721 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:25.529597 (+ 1876us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:25.532375 (+ 2778us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.532383 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.532385 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.532673 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.532879 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:25.532880 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:25.532880 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:25.533020 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:25.533285 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:25.533294 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:25.533454 (+ 160us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.533625 (+ 171us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.534370 (+ 745us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"mutex_wait_us":43,"thread_start_us":81,"threads_started":1}
I20260808 05:08:25.535288 24164 heartbeater.cc:347] Connected to a master server at 127.12.251.60:42731
I20260808 05:08:25.535493 24164 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.535702 24164 heartbeater.cc:511] Master 127.12.251.60:42731 requested a full tablet report, sending...
I20260808 05:08:25.536037 24166 heartbeater.cc:347] Connected to a master server at 127.12.251.61:42839
I20260808 05:08:25.536084 24166 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.536150 24166 heartbeater.cc:511] Master 127.12.251.61:42839 requested a full tablet report, sending...
I20260808 05:08:25.536345 23523 ts_manager.cc:194] Registered new tserver with Master: 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515)
I20260808 05:08:25.534343 22432 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:25.536590 22432 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:25.536638 23274 ts_manager.cc:194] Registered new tserver with Master: 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515)
I20260808 05:08:25.537122 22515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.521326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:57005 (local address 127.12.251.62:35073)
0808 05:08:25.521710 (+ 384us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.521712 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.521723 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:08:25.521831 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.521832 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.521844 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.521873 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.523525 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.524233 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.525759 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.526019 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.526060 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.530871 (+ 4811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.530873 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.530873 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.530881 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.532467 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533035 (+ 568us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.533036 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.533036 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.533486 (+ 450us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.533693 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.533694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.533694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.533955 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.534007 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.534197 (+ 190us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.534275 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":359}
I20260808 05:08:25.537318 24181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.522015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34982 (local address 127.12.251.61:42839)
0808 05:08:25.522936 (+ 921us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.522938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.522954 (+ 16us) server_negotiation.cc:407] Connection header received
0808 05:08:25.522974 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.522975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.522986 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.526521 (+ 3535us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.526561 (+ 40us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.527263 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.528235 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.528534 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.528591 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.530522 (+ 1931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.530523 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.530523 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.530530 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.536095 (+ 5565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.536464 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.536465 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.536466 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.536525 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.536711 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.536711 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.536712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.536831 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.536915 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.537098 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.537184 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":901,"thread_start_us":59,"threads_started":1}
I20260808 05:08:25.537523 24165 heartbeater.cc:347] Connected to a master server at 127.12.251.62:35073
I20260808 05:08:25.537568 24165 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:25.537631 24165 heartbeater.cc:511] Master 127.12.251.62:35073 requested a full tablet report, sending...
I20260808 05:08:25.537858 23483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: NON_VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: true } } }
I20260808 05:08:25.537961 23483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:25.538316 22429 ts_manager.cc:194] Re-registered known tserver with Master: 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515)
I20260808 05:08:25.538767 22429 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:57005
I20260808 05:08:25.539690 24189 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: attempting to promote NON_VOTER 5439fbeb51ff4c2aaea1b7dea892472b to VOTER
I20260808 05:08:25.539809 24189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } }
I20260808 05:08:25.540031 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.522280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39850 (local address 127.12.251.60:42731)
0808 05:08:25.522948 (+ 668us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.522950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.522958 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:25.522983 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.522983 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.522995 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.523061 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.528908 (+ 5847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.529680 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.530650 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.530919 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.530980 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.532231 (+ 1251us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.532233 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.532233 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.532240 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.537822 (+ 5582us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.539043 (+ 1221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.539044 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.539044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.539105 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.539303 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.539304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.539304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.539423 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.539521 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.539869 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.539948 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":608,"thread_start_us":115,"threads_started":1}
I20260808 05:08:25.540525 23286 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Refusing update from remote peer 15f1e66e325f414cabdf9cd4897b70b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 05:08:25.540668 23538 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 LEARNER]: Refusing update from remote peer 15f1e66e325f414cabdf9cd4897b70b3: Log matching property violated. Preceding OpId in replica: term: 1 index: 8. Preceding OpId from leader: term: 1 index: 9. (index mismatch)
I20260808 05:08:25.540723 23483 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 05:08:25.541016 24187 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260808 05:08:25.541339 23483 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [term 1 LEADER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.542136 23286 raft_consensus.cc:2932] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.542201 23538 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Committing config change with OpId 1.9: config changed from index 7 to 9, 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.614934 23483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.615103 23483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:25.615060 24128 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.615154 24128 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:08:25.615160 23483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.615200 23483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:25.615249 23483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.615284 23483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:25.615522 24199 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "15f1e66e325f414cabdf9cd4897b70b3" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:25.615629 24199 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:08:25.620993 24204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.616264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:46515 (local address 127.0.0.1:53024)
0808 05:08:25.616610 (+ 346us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.616621 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.616673 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.617391 (+ 718us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.617391 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.617393 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:25.617435 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.617436 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.618681 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.618682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.619769 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.619771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.620739 (+ 968us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.620740 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.620803 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.620807 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.620836 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.620880 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"mutex_wait_us":6,"thread_start_us":96,"threads_started":1}
I20260808 05:08:25.621090 24018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.616166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:33437 (local address 127.0.0.1:50030)
0808 05:08:25.616223 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.616235 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.616286 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.616890 (+ 604us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.616891 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.616894 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:25.616960 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.616961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.618520 (+ 1559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.618521 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.619572 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.619575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.620813 (+ 1238us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.620814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.620881 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.620885 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.620911 (+ 26us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.620971 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":1}
I20260808 05:08:25.621177 24206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.616648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41686 (local address 127.12.251.1:35611)
0808 05:08:25.616843 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.616846 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.616956 (+ 110us) server_negotiation.cc:407] Connection header received
0808 05:08:25.617072 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.617074 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.617089 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.617136 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:25.617374 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.618469 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.619870 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.620620 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.620671 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.620752 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.620959 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.621012 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":79,"threads_started":1}
I20260808 05:08:25.621420 24200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.616461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:35611 (local address 127.0.0.1:41686)
0808 05:08:25.616900 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.616909 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.616991 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.617242 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.617243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.617245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:25.617293 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.617296 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.618611 (+ 1315us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.618612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.619769 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.619771 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.620818 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.620818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.620874 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.620877 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.621311 (+ 434us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.621357 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":425,"mutex_wait_us":6,"thread_start_us":81,"threads_started":1}
I20260808 05:08:25.621534 24203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.616277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50030 (local address 127.12.251.2:33437)
0808 05:08:25.616710 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.616716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.616726 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:25.616771 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.616773 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.616789 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.617022 (+ 233us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:25.617079 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.618431 (+ 1352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.619668 (+ 1237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.620724 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.621170 (+ 446us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.621390 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.621417 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.621458 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":169,"threads_started":1}
I20260808 05:08:25.621717 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.616459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53024 (local address 127.12.251.3:46515)
0808 05:08:25.616838 (+ 379us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.616844 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.617195 (+ 351us) server_negotiation.cc:407] Connection header received
0808 05:08:25.617262 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.617264 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.617281 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.617518 (+ 237us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:25.617576 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.618596 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.619867 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.620654 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.621251 (+ 597us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.621326 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.621364 (+ 38us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.621404 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":335,"thread_start_us":126,"threads_started":1}
I20260808 05:08:25.622210 23877 tablet_service.cc:1467] Processing CreateTablet for tablet 838a8a73375c405284c2527a73bffb3d (DEFAULT_TABLE table=test-table [id=f4c6d57007374c5eaad3b9e9a6d377eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:25.622355 23692 tablet_service.cc:1467] Processing CreateTablet for tablet 838a8a73375c405284c2527a73bffb3d (DEFAULT_TABLE table=test-table [id=f4c6d57007374c5eaad3b9e9a6d377eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:25.622489 24071 tablet_service.cc:1467] Processing CreateTablet for tablet 838a8a73375c405284c2527a73bffb3d (DEFAULT_TABLE table=test-table [id=f4c6d57007374c5eaad3b9e9a6d377eb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:25.622603 23877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 838a8a73375c405284c2527a73bffb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:25.622709 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 838a8a73375c405284c2527a73bffb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:25.622804 24071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 838a8a73375c405284c2527a73bffb3d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:25.626222 24211 tablet_bootstrap.cc:492] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Bootstrap starting.
I20260808 05:08:25.626349 24208 tablet_bootstrap.cc:492] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Bootstrap starting.
I20260808 05:08:25.626410 24212 tablet_bootstrap.cc:492] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Bootstrap starting.
I20260808 05:08:25.626920 24208 tablet_bootstrap.cc:654] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:25.626974 24212 tablet_bootstrap.cc:654] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:25.626974 24211 tablet_bootstrap.cc:654] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:25.627204 24208 log.cc:824] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:25.627290 24212 log.cc:824] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:25.627306 24211 log.cc:824] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:25.627933 24208 tablet_bootstrap.cc:492] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: No bootstrap required, opened a new log
I20260808 05:08:25.628006 24208 ts_tablet_manager.cc:1397] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:25.628036 24211 tablet_bootstrap.cc:492] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: No bootstrap required, opened a new log
I20260808 05:08:25.628036 24212 tablet_bootstrap.cc:492] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: No bootstrap required, opened a new log
I20260808 05:08:25.628106 24211 ts_tablet_manager.cc:1397] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:25.628106 24212 ts_tablet_manager.cc:1397] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:25.629837 24208 raft_consensus.cc:348] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.629967 24208 raft_consensus.cc:374] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:25.630012 24208 raft_consensus.cc:729] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa905a84e86452ca57fbc8736a29b36, State: Initialized, Role: FOLLOWER
I20260808 05:08:25.630024 24211 raft_consensus.cc:348] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.630120 24208 consensus_queue.cc:260] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.630100 24212 raft_consensus.cc:348] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.630184 24211 raft_consensus.cc:374] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:25.630224 24211 raft_consensus.cc:729] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9a7d193bd044e6a6759009f015c0b2, State: Initialized, Role: FOLLOWER
I20260808 05:08:25.630226 24212 raft_consensus.cc:374] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:25.630259 24212 raft_consensus.cc:729] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d31de13cd0a4929a3fe6b0783465013, State: Initialized, Role: FOLLOWER
I20260808 05:08:25.630347 24211 consensus_queue.cc:260] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.630360 24212 consensus_queue.cc:260] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.630411 24208 ts_tablet_manager.cc:1428] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:08:25.630527 23785 heartbeater.cc:503] Master 127.12.251.62:35073 was elected leader, sending a full tablet report...
I20260808 05:08:25.630616 24211 ts_tablet_manager.cc:1428] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:08:25.630748 24165 heartbeater.cc:503] Master 127.12.251.62:35073 was elected leader, sending a full tablet report...
I20260808 05:08:25.631987 24212 ts_tablet_manager.cc:1428] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 05:08:25.632036 23971 heartbeater.cc:503] Master 127.12.251.62:35073 was elected leader, sending a full tablet report...
W20260808 05:08:25.665257 23787 tablet.cc:2369] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:25.735644 24218 raft_consensus.cc:482] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:25.735769 24218 raft_consensus.cc:504] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.736140 24218 leader_election.cc:288] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515), cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1:35611)
I20260808 05:08:25.738988 24205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.736378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44141 (local address 127.12.251.3:46515)
0808 05:08:25.736457 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.736459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.736495 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:08:25.736525 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.736526 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.736537 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.736577 (+ 40us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:25.736736 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.737305 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.738282 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.738651 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.738713 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.738723 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.738872 (+ 149us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.738913 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:08:25.738999 23976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.736305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:46515 (local address 127.12.251.2:44141)
0808 05:08:25.736365 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.736377 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.736432 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.736589 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.736590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.736592 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:25.736677 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.736678 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.737385 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.737386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.738188 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.738191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.738729 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.738730 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.738807 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.738810 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.738854 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.738896 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":25}
I20260808 05:08:25.738997 24206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.736528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:50001 (local address 127.12.251.1:35611)
0808 05:08:25.736583 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.736585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.736592 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:25.736617 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.736618 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.736626 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.736703 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:25.736869 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.737394 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.738293 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.738656 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.738722 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.738731 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.738873 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.738914 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:08:25.739005 23974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.736407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:35611 (local address 127.12.251.2:50001)
0808 05:08:25.736457 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:25.736467 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:25.736504 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:25.736724 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:25.736725 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:25.736727 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:25.736805 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.736806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.737467 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.737468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.738211 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:25.738214 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.738735 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.738737 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:25.738811 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.738814 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:25.738859 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:08:25.738918 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":1}
I20260808 05:08:25.739317 23723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "838a8a73375c405284c2527a73bffb3d" candidate_uuid: "0d31de13cd0a4929a3fe6b0783465013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa905a84e86452ca57fbc8736a29b36" is_pre_election: true
I20260808 05:08:25.739493 23723 raft_consensus.cc:2454] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d31de13cd0a4929a3fe6b0783465013 in term 0.
I20260808 05:08:25.739509 24097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "838a8a73375c405284c2527a73bffb3d" candidate_uuid: "0d31de13cd0a4929a3fe6b0783465013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9a7d193bd044e6a6759009f015c0b2" is_pre_election: true
I20260808 05:08:25.739668 24097 raft_consensus.cc:2454] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d31de13cd0a4929a3fe6b0783465013 in term 0.
I20260808 05:08:25.739737 23818 leader_election.cc:302] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d31de13cd0a4929a3fe6b0783465013, cfa905a84e86452ca57fbc8736a29b36; no voters:
I20260808 05:08:25.739880 24218 raft_consensus.cc:2781] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:25.739936 24218 raft_consensus.cc:482] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:25.739957 24218 raft_consensus.cc:3037] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Advancing to term 1
W20260808 05:08:25.771337 24169 tablet.cc:2369] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:08:25.812862 23973 tablet.cc:2369] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:25.817130 24218 raft_consensus.cc:504] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.817384 24218 leader_election.cc:288] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [CANDIDATE]: Term 1 election: Requested vote from peers 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515), cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1:35611)
I20260808 05:08:25.817652 23723 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "838a8a73375c405284c2527a73bffb3d" candidate_uuid: "0d31de13cd0a4929a3fe6b0783465013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfa905a84e86452ca57fbc8736a29b36"
I20260808 05:08:25.817688 24097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "838a8a73375c405284c2527a73bffb3d" candidate_uuid: "0d31de13cd0a4929a3fe6b0783465013" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9a7d193bd044e6a6759009f015c0b2"
I20260808 05:08:25.817771 23723 raft_consensus.cc:3037] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:25.817795 24097 raft_consensus.cc:3037] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:25.818572 23723 raft_consensus.cc:2454] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d31de13cd0a4929a3fe6b0783465013 in term 1.
I20260808 05:08:25.818727 24097 raft_consensus.cc:2454] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d31de13cd0a4929a3fe6b0783465013 in term 1.
I20260808 05:08:25.818766 23818 leader_election.cc:302] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d31de13cd0a4929a3fe6b0783465013, cfa905a84e86452ca57fbc8736a29b36; no voters:
I20260808 05:08:25.818868 24218 raft_consensus.cc:2781] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:25.819006 24218 raft_consensus.cc:686] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 1 LEADER]: Becoming Leader. State: Replica: 0d31de13cd0a4929a3fe6b0783465013, State: Running, Role: LEADER
I20260808 05:08:25.819171 24218 consensus_queue.cc:237] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:25.820075 22429 catalog_manager.cc:5495] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "0d31de13cd0a4929a3fe6b0783465013" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:25.845741 24203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.843637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50040 (local address 127.12.251.2:33437)
0808 05:08:25.843677 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.843679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.843687 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:25.843723 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.843724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.843740 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.843794 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:25.843906 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.844368 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.845070 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.845289 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.845339 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.845482 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:25.845583 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:25.845652 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.845664 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.845683 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:25.847538 24097 raft_consensus.cc:1261] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Refusing update from remote peer 0d31de13cd0a4929a3fe6b0783465013: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:25.847538 23723 raft_consensus.cc:1261] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 1 FOLLOWER]: Refusing update from remote peer 0d31de13cd0a4929a3fe6b0783465013: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:25.847908 24219 consensus_queue.cc:1035] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:25.848047 24218 consensus_queue.cc:1035] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:25.850584 24224 mvcc.cc:205] Tried to move back new op lower bound from 7316134731148832768 to 7316134731036000256. Current Snapshot: MvccSnapshot[applied={T|T < 7316134731148832768}]
I20260808 05:08:25.852205 24225 mvcc.cc:205] Tried to move back new op lower bound from 7316134731148832768 to 7316134731036000256. Current Snapshot: MvccSnapshot[applied={T|T < 7316134731148832768}]
I20260808 05:08:25.853376 22429 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:25.853475 22429 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:25.854933 22429 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15f1e66e325f414cabdf9cd4897b70b3: Sending DeleteTablet for 3 replicas of tablet 838a8a73375c405284c2527a73bffb3d
I20260808 05:08:25.855294 23877 tablet_service.cc:1514] Processing DeleteTablet for tablet 838a8a73375c405284c2527a73bffb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:25 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:50030
I20260808 05:08:25.855304 23692 tablet_service.cc:1514] Processing DeleteTablet for tablet 838a8a73375c405284c2527a73bffb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:25 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:41686
I20260808 05:08:25.855527 24071 tablet_service.cc:1514] Processing DeleteTablet for tablet 838a8a73375c405284c2527a73bffb3d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:25 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:53024
I20260808 05:08:25.856065 24242 tablet_replica.cc:330] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: stopping tablet replica
I20260808 05:08:25.856139 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 22379
I20260808 05:08:25.860898 24239 tablet_replica.cc:330] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: stopping tablet replica
I20260808 05:08:25.861024 24239 raft_consensus.cc:2229] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:25.861135 24239 raft_consensus.cc:2258] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:25.856175 24242 raft_consensus.cc:2229] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:25.861334 24242 raft_consensus.cc:2258] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:25.861776 24242 ts_tablet_manager.cc:1905] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:25.861814 24239 ts_tablet_manager.cc:1905] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:25.865341 24240 tablet_replica.cc:330] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: stopping tablet replica
I20260808 05:08:25.865522 24240 raft_consensus.cc:2229] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:25.865687 24240 raft_consensus.cc:2258] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:25.866271 24240 ts_tablet_manager.cc:1905] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260808 05:08:25.870659 23250 connection.cc:535] server connection from 127.0.0.1:34966 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:08:25.879594 24184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.872276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39858 (local address 127.12.251.60:42731)
0808 05:08:25.872455 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.872457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.872744 (+ 287us) server_negotiation.cc:407] Connection header received
0808 05:08:25.872776 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.872777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.872791 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.872853 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.873697 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.874179 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.875019 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.875226 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.875283 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.876992 (+ 1709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.876994 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.876995 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.877002 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.878404 (+ 1402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.878738 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.878739 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.878740 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.878799 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.879003 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.879004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.879004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.879136 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.879227 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.879404 (+ 177us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.879494 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152}
I20260808 05:08:25.879881 24181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:25.872507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34986 (local address 127.12.251.61:42839)
0808 05:08:25.872564 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:25.872566 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:25.872574 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:25.872595 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:25.872596 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:25.872608 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:25.872656 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:25.873409 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.874200 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.875396 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:25.875671 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:25.875733 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:25.876973 (+ 1240us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:25.876974 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:25.876975 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:25.876982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:25.878667 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.879061 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.879062 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.879062 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.879112 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:25.879299 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:25.879300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:25.879300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:25.879423 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:25.879519 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:25.879701 (+ 182us) server_negotiation.cc:299] Negotiation successful
0808 05:08:25.879786 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:25.918288 24239 ts_tablet_manager.cc:1918] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:25.918299 24242 ts_tablet_manager.cc:1918] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:25.918391 24239 log.cc:1196] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/838a8a73375c405284c2527a73bffb3d
I20260808 05:08:25.918398 24242 log.cc:1196] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/838a8a73375c405284c2527a73bffb3d
I20260808 05:08:25.918648 24239 ts_tablet_manager.cc:1939] T 838a8a73375c405284c2527a73bffb3d P 0d31de13cd0a4929a3fe6b0783465013: Deleting consensus metadata
I20260808 05:08:25.918670 24242 ts_tablet_manager.cc:1939] T 838a8a73375c405284c2527a73bffb3d P 9a9a7d193bd044e6a6759009f015c0b2: Deleting consensus metadata
W20260808 05:08:25.931313 23821 connection.cc:441] server connection from 127.0.0.1:50030 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50030 (request call id 1) could send its response
W20260808 05:08:25.931310 24012 connection.cc:441] server connection from 127.0.0.1:53024 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:53024 (request call id 1) could send its response
I20260808 05:08:25.952193 24240 ts_tablet_manager.cc:1918] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:25.952298 24240 log.cc:1196] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/838a8a73375c405284c2527a73bffb3d
I20260808 05:08:25.952576 24240 ts_tablet_manager.cc:1939] T 838a8a73375c405284c2527a73bffb3d P cfa905a84e86452ca57fbc8736a29b36: Deleting consensus metadata
W20260808 05:08:25.960800 23637 connection.cc:441] server connection from 127.0.0.1:41686 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:41686 (request call id 1) could send its response
I20260808 05:08:26.851821 24252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:26.851533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.2:39955)
0808 05:08:26.851676 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:26.851746 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":60,"threads_started":1}
I20260808 05:08:26.852064 24253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:26.851667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.3:56887)
0808 05:08:26.851798 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:26.851882 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":58,"threads_started":1}
W20260808 05:08:26.852103 23971 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:35073 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
W20260808 05:08:26.852285 24165 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:35073 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
I20260808 05:08:26.852764 24254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:26.852517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.1:33177)
0808 05:08:26.852635 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:26.852709 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":56,"threads_started":1}
W20260808 05:08:26.852934 23785 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:35073 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
I20260808 05:08:27.354949 24255 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 15f1e66e325f414cabdf9cd4897b70b3)
I20260808 05:08:27.355142 24255 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } }
I20260808 05:08:27.355496 24255 leader_election.cc:288] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15f1e66e325f414cabdf9cd4897b70b3 (127.12.251.62:35073), f4088adbe03e4be1b6b353431c5795bc (127.12.251.61:42839)
I20260808 05:08:27.355866 24259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.355563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54794)
0808 05:08:27.355731 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.355822 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":48,"threads_started":1}
W20260808 05:08:27.355988 23509 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
I20260808 05:08:27.356372 24259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.356275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54802)
0808 05:08:27.356313 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.356347 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 05:08:27.356477 23509 leader_election.cc:334] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 15f1e66e325f414cabdf9cd4897b70b3 (127.12.251.62:35073): Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
I20260808 05:08:27.358503 24257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.355631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:42839 (local address 127.0.0.1:36316)
0808 05:08:27.355739 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.355750 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:27.355804 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:27.355996 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:27.355997 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:27.355999 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:27.356051 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.356053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.356894 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.356895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.357787 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.357790 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.358281 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.358282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.358366 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.358370 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:27.358420 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:08:27.358455 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":93,"thread_start_us":52,"threads_started":1}
I20260808 05:08:27.358512 24260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.355691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36316 (local address 127.12.251.61:42839)
0808 05:08:27.355806 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.355808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.355844 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:08:27.355870 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.355870 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.355881 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.355940 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:27.356121 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.356812 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.357852 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.358214 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.358268 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.358278 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.358428 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.358455 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":54,"threads_started":1}
I20260808 05:08:27.358738 23286 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "f4088adbe03e4be1b6b353431c5795bc" is_pre_election: true
I20260808 05:08:27.358997 23505 leader_election.cc:302] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5439fbeb51ff4c2aaea1b7dea892472b; no voters: 15f1e66e325f414cabdf9cd4897b70b3, f4088adbe03e4be1b6b353431c5795bc
I20260808 05:08:27.359107 24255 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:08:27.369805 24262 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 15f1e66e325f414cabdf9cd4897b70b3)
I20260808 05:08:27.369923 24262 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } }
I20260808 05:08:27.370148 24262 leader_election.cc:288] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 15f1e66e325f414cabdf9cd4897b70b3 (127.12.251.62:35073), 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60:42731)
I20260808 05:08:27.370452 24264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.370249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54816)
0808 05:08:27.370365 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.370413 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
W20260808 05:08:27.370564 23253 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
I20260808 05:08:27.371027 24264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.370930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54832)
0808 05:08:27.370973 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.371006 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 05:08:27.371114 23253 leader_election.cc:334] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 15f1e66e325f414cabdf9cd4897b70b3 (127.12.251.62:35073): Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
I20260808 05:08:27.373031 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.370286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:42731 (local address 127.0.0.1:39338)
0808 05:08:27.370373 (+ 87us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.370385 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:27.370439 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:27.370685 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:27.370687 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:27.370689 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:27.370737 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.370740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.371514 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.371515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.372364 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.372366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.372863 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.372864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.372904 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.372908 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:27.372942 (+ 34us) client_negotiation.cc:240] Negotiation successful
0808 05:08:27.372971 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77,"thread_start_us":50,"threads_started":1}
I20260808 05:08:27.373036 24269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.370387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39338 (local address 127.12.251.60:42731)
0808 05:08:27.370529 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.370531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.370540 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:27.370561 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.370562 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.370572 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.370644 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:27.370825 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.371434 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.372435 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.372805 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.372860 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.372870 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.372954 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.372981 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260808 05:08:27.373276 23538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4088adbe03e4be1b6b353431c5795bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" is_pre_election: true
I20260808 05:08:27.373373 23538 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4088adbe03e4be1b6b353431c5795bc in term 1.
I20260808 05:08:27.373531 23251 leader_election.cc:302] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5439fbeb51ff4c2aaea1b7dea892472b, f4088adbe03e4be1b6b353431c5795bc; no voters: 15f1e66e325f414cabdf9cd4897b70b3
I20260808 05:08:27.373639 24262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260808 05:08:27.373682 24262 raft_consensus.cc:482] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Starting leader election (detected failure of leader 15f1e66e325f414cabdf9cd4897b70b3)
I20260808 05:08:27.373703 24262 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:08:27.374393 24262 raft_consensus.cc:504] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 2 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } }
I20260808 05:08:27.374511 24262 leader_election.cc:288] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [CANDIDATE]: Term 2 election: Requested vote from peers 15f1e66e325f414cabdf9cd4897b70b3 (127.12.251.62:35073), 5439fbeb51ff4c2aaea1b7dea892472b (127.12.251.60:42731)
I20260808 05:08:27.374662 23538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f4088adbe03e4be1b6b353431c5795bc" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "5439fbeb51ff4c2aaea1b7dea892472b"
I20260808 05:08:27.374732 23538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:08:27.375293 23538 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4088adbe03e4be1b6b353431c5795bc in term 2.
I20260808 05:08:27.375453 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.374607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54840)
0808 05:08:27.375383 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.375418 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":757}
I20260808 05:08:27.375486 23251 leader_election.cc:302] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5439fbeb51ff4c2aaea1b7dea892472b, f4088adbe03e4be1b6b353431c5795bc; no voters:
I20260808 05:08:27.375710 24262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:08:27.375756 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.375672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54846)
0808 05:08:27.375711 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.375736 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:08:27.375850 24262 raft_consensus.cc:686] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [term 2 LEADER]: Becoming Leader. State: Replica: f4088adbe03e4be1b6b353431c5795bc, State: Running, Role: LEADER
I20260808 05:08:27.375919 24262 consensus_queue.cc:237] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } }
W20260808 05:08:27.376159 23253 leader_election.cc:334] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 15f1e66e325f414cabdf9cd4897b70b3 (127.12.251.62:35073): Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
I20260808 05:08:27.376202 24271 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4088adbe03e4be1b6b353431c5795bc. Latest consensus state: current_term: 2 leader_uuid: "f4088adbe03e4be1b6b353431c5795bc" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:27.376307 24271 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:27.376473 24273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:27.376963 24273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:27.377048 24273 catalog_manager.cc:1259] Loaded cluster ID: a1e5616c1af240538225b16709bd153a
I20260808 05:08:27.377079 24273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:27.377265 24273 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:27.377347 24273 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Loaded TSK: 0
I20260808 05:08:27.377482 24273 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:08:27.411378 23273 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34986:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:27.412977 23273 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:27.413992 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.413903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54858)
0808 05:08:27.413935 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.413963 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 05:08:27.414034 23538 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [term 2 FOLLOWER]: Refusing update from remote peer f4088adbe03e4be1b6b353431c5795bc: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 2 index: 14. (index mismatch)
I20260808 05:08:27.414352 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.414239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.0.0.1:54860)
0808 05:08:27.414282 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.414306 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260808 05:08:27.414301 24271 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260808 05:08:27.414430 23253 consensus_peers.cc:487] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc -> Peer 15f1e66e325f414cabdf9cd4897b70b3 (127.12.251.62:35073): Couldn't send request to peer 15f1e66e325f414cabdf9cd4897b70b3. Status: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260808 05:08:27.414929 24255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: SysCatalogTable state changed. Reason: New leader f4088adbe03e4be1b6b353431c5795bc. Latest consensus state: current_term: 2 leader_uuid: "f4088adbe03e4be1b6b353431c5795bc" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:27.415014 24255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:08:27.415580 24255 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f4088adbe03e4be1b6b353431c5795bc" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:27.415740 24255 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5439fbeb51ff4c2aaea1b7dea892472b [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:08:27.415457 24271 sys_catalog.cc:455] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f4088adbe03e4be1b6b353431c5795bc" committed_config { opid_index: 9 OBSOLETE_local: true peers { permanent_uuid: "15f1e66e325f414cabdf9cd4897b70b3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35073 } } peers { permanent_uuid: "f4088adbe03e4be1b6b353431c5795bc" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 42839 } attrs { promote: false } } peers { permanent_uuid: "5439fbeb51ff4c2aaea1b7dea892472b" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 42731 } attrs { promote: false } } }
I20260808 05:08:27.415555 24275 mvcc.cc:205] Tried to move back new op lower bound from 7316134737566064640 to 7316134737412218880. Current Snapshot: MvccSnapshot[applied={T|T < 7316134737566064640}]
I20260808 05:08:27.415848 24271 sys_catalog.cc:458] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:27.419999 24268 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.417068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:33437 (local address 127.0.0.1:59074)
0808 05:08:27.417111 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.417121 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:27.417163 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:27.417444 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:27.417445 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:27.417446 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:27.417506 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.417508 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.418406 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.418407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.419165 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.419167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.419809 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.419811 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.419867 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.419873 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:08:27.419899 (+ 26us) client_negotiation.cc:240] Negotiation successful
0808 05:08:27.419934 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 05:08:27.420244 24281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.417145 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59074 (local address 127.12.251.2:33437)
0808 05:08:27.417302 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.417305 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.417312 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:27.417339 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.417340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.417351 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.417572 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:27.417615 (+ 43us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.418314 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.419242 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.419723 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.420106 (+ 383us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.420120 (+ 14us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.420139 (+ 19us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.420178 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260808 05:08:27.420269 24282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.417150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:46515 (local address 127.0.0.1:46522)
0808 05:08:27.417356 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.417367 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:27.417406 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:27.417671 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:27.417672 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:27.417674 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:27.417719 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.417721 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.418379 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.418380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.419431 (+ 1051us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.419434 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.420063 (+ 629us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.420064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.420127 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.420132 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:27.420160 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 05:08:27.420198 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185}
I20260808 05:08:27.420428 23877 tablet_service.cc:1467] Processing CreateTablet for tablet 118151730187422897124be1e3601c2e (DEFAULT_TABLE table=test-table [id=d2de290a1fc8490fa482f22f0dbb490a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:27.420588 23877 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 118151730187422897124be1e3601c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:27.420614 24264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.417241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:35611 (local address 127.0.0.1:37452)
0808 05:08:27.417510 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.417520 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:27.417598 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:27.417783 (+ 185us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:27.417784 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:27.417786 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:27.417816 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.417816 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.418661 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.418662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.419691 (+ 1029us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.419693 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.420404 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.420405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.420464 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.420467 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:27.420516 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:08:27.420554 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":2,"thread_start_us":71,"threads_started":1}
I20260808 05:08:27.420632 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.417410 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46522 (local address 127.12.251.3:46515)
0808 05:08:27.417516 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.417518 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.417526 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:27.417554 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.417555 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.417565 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.417623 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:27.417789 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.418308 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.419529 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.419996 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.420477 (+ 481us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.420493 (+ 16us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.420513 (+ 20us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.420556 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":65,"threads_started":1}
I20260808 05:08:27.420882 24071 tablet_service.cc:1467] Processing CreateTablet for tablet 118151730187422897124be1e3601c2e (DEFAULT_TABLE table=test-table [id=d2de290a1fc8490fa482f22f0dbb490a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:27.421017 24071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 118151730187422897124be1e3601c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:27.421017 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.417327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37452 (local address 127.12.251.1:35611)
0808 05:08:27.417432 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.417434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.417572 (+ 138us) server_negotiation.cc:407] Connection header received
0808 05:08:27.417673 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.417674 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.417684 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.417721 (+ 37us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:27.417889 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.418584 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.419768 (+ 1184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.420297 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.420360 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.420372 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.420567 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.420612 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84,"thread_start_us":51,"threads_started":1}
I20260808 05:08:27.421425 23692 tablet_service.cc:1467] Processing CreateTablet for tablet 118151730187422897124be1e3601c2e (DEFAULT_TABLE table=test-table [id=d2de290a1fc8490fa482f22f0dbb490a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:27.421548 23692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 118151730187422897124be1e3601c2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:27.422410 24289 tablet_bootstrap.cc:492] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: Bootstrap starting.
I20260808 05:08:27.422428 24287 tablet_bootstrap.cc:492] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: Bootstrap starting.
I20260808 05:08:27.422715 24289 tablet_bootstrap.cc:654] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:27.422781 24287 tablet_bootstrap.cc:654] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:27.422914 24291 tablet_bootstrap.cc:492] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36: Bootstrap starting.
I20260808 05:08:27.423195 24291 tablet_bootstrap.cc:654] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:27.423467 24289 tablet_bootstrap.cc:492] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: No bootstrap required, opened a new log
I20260808 05:08:27.423566 24289 ts_tablet_manager.cc:1397] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:27.423573 24287 tablet_bootstrap.cc:492] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: No bootstrap required, opened a new log
I20260808 05:08:27.423615 24287 ts_tablet_manager.cc:1397] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:27.423728 24287 raft_consensus.cc:348] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.423733 24289 raft_consensus.cc:348] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.423796 24289 raft_consensus.cc:374] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:27.423799 24287 raft_consensus.cc:374] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:27.423815 24289 raft_consensus.cc:729] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a9a7d193bd044e6a6759009f015c0b2, State: Initialized, Role: FOLLOWER
I20260808 05:08:27.423820 24287 raft_consensus.cc:729] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d31de13cd0a4929a3fe6b0783465013, State: Initialized, Role: FOLLOWER
I20260808 05:08:27.423878 24289 consensus_queue.cc:260] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.423882 24287 consensus_queue.cc:260] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.424032 24287 ts_tablet_manager.cc:1428] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:27.424176 24289 ts_tablet_manager.cc:1428] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260808 05:08:27.424681 24166 heartbeater.cc:503] Master 127.12.251.61:42839 was elected leader, sending a full tablet report...
I20260808 05:08:27.424880 23972 heartbeater.cc:503] Master 127.12.251.61:42839 was elected leader, sending a full tablet report...
I20260808 05:08:27.425169 24299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.424344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.2:47121)
0808 05:08:27.425088 (+ 744us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.425134 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":70,"threads_started":1}
I20260808 05:08:27.425232 24291 tablet_bootstrap.cc:492] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36: No bootstrap required, opened a new log
I20260808 05:08:27.425287 24291 ts_tablet_manager.cc:1397] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:27.425364 24298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.424179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.3:41329)
0808 05:08:27.425287 (+ 1108us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.425327 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1084,"thread_start_us":74,"threads_started":1}
I20260808 05:08:27.425433 24291 raft_consensus.cc:348] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.425529 24291 raft_consensus.cc:374] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:27.425558 24291 raft_consensus.cc:729] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfa905a84e86452ca57fbc8736a29b36, State: Initialized, Role: FOLLOWER
I20260808 05:08:27.425611 24291 consensus_queue.cc:260] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.425654 24301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.425398 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.2:48237)
0808 05:08:27.425515 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.425624 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":88,"threads_started":1}
I20260808 05:08:27.425761 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.425567 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.3:52467)
0808 05:08:27.425685 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.425718 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":72,"threads_started":1}
I20260808 05:08:27.425818 24291 ts_tablet_manager.cc:1428] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:27.426271 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.426050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.1:44649)
0808 05:08:27.426177 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.426228 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":81,"threads_started":1}
I20260808 05:08:27.426330 23786 heartbeater.cc:503] Master 127.12.251.61:42839 was elected leader, sending a full tablet report...
I20260808 05:08:27.634409 24303 raft_consensus.cc:482] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:27.634526 24303 raft_consensus.cc:504] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.634855 24303 leader_election.cc:288] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2:33437), 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515)
I20260808 05:08:27.637636 24281 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.635163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:49441 (local address 127.12.251.2:33437)
0808 05:08:27.635230 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.635232 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.635244 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:08:27.635279 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.635279 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.635292 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.635352 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:27.635506 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.635974 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.636915 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.637325 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.637389 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.637401 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.637533 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.637572 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:08:27.637660 24304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.635045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:33437 (local address 127.12.251.1:49441)
0808 05:08:27.635118 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.635131 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:27.635218 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:27.635366 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:27.635367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:27.635369 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:27.635440 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.635442 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.636050 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.636051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.636829 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.636831 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.637389 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.637390 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.637464 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.637468 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:27.637511 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:08:27.637552 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43}
I20260808 05:08:27.638008 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.635143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:46515 (local address 127.12.251.1:60701)
0808 05:08:27.635341 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.635348 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:27.635392 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:27.635508 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:27.635508 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:27.635510 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:27.635586 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.635587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.636235 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.636236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.637003 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:27.637006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.637618 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.637619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:27.637687 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.637691 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:27.637891 (+ 200us) client_negotiation.cc:240] Negotiation successful
0808 05:08:27.637943 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":114,"threads_started":1}
I20260808 05:08:27.637955 23910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "118151730187422897124be1e3601c2e" candidate_uuid: "cfa905a84e86452ca57fbc8736a29b36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d31de13cd0a4929a3fe6b0783465013" is_pre_election: true
I20260808 05:08:27.638046 24286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.635220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:60701 (local address 127.12.251.3:46515)
0808 05:08:27.635264 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.635266 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.635402 (+ 136us) server_negotiation.cc:407] Connection header received
0808 05:08:27.635438 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.635439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.635449 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.635500 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:27.635644 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.636157 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.637095 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.637511 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.637571 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.637580 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.637933 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.637987 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:27.638090 23910 raft_consensus.cc:2454] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfa905a84e86452ca57fbc8736a29b36 in term 0.
I20260808 05:08:27.638275 24097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "118151730187422897124be1e3601c2e" candidate_uuid: "cfa905a84e86452ca57fbc8736a29b36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9a7d193bd044e6a6759009f015c0b2" is_pre_election: true
I20260808 05:08:27.638290 23633 leader_election.cc:302] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d31de13cd0a4929a3fe6b0783465013, cfa905a84e86452ca57fbc8736a29b36; no voters:
I20260808 05:08:27.638358 24097 raft_consensus.cc:2454] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfa905a84e86452ca57fbc8736a29b36 in term 0.
I20260808 05:08:27.638439 24303 raft_consensus.cc:2781] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:27.638485 24303 raft_consensus.cc:482] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:27.638504 24303 raft_consensus.cc:3037] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:27.639247 24303 raft_consensus.cc:504] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.639364 24303 leader_election.cc:288] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [CANDIDATE]: Term 1 election: Requested vote from peers 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2:33437), 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515)
I20260808 05:08:27.639536 23910 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "118151730187422897124be1e3601c2e" candidate_uuid: "cfa905a84e86452ca57fbc8736a29b36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d31de13cd0a4929a3fe6b0783465013"
I20260808 05:08:27.639564 24097 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "118151730187422897124be1e3601c2e" candidate_uuid: "cfa905a84e86452ca57fbc8736a29b36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a9a7d193bd044e6a6759009f015c0b2"
I20260808 05:08:27.639617 23910 raft_consensus.cc:3037] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:27.639627 24097 raft_consensus.cc:3037] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:27.640363 24097 raft_consensus.cc:2454] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfa905a84e86452ca57fbc8736a29b36 in term 1.
I20260808 05:08:27.640376 23910 raft_consensus.cc:2454] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfa905a84e86452ca57fbc8736a29b36 in term 1.
I20260808 05:08:27.640509 23633 leader_election.cc:302] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d31de13cd0a4929a3fe6b0783465013, cfa905a84e86452ca57fbc8736a29b36; no voters:
I20260808 05:08:27.640594 24303 raft_consensus.cc:2781] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:27.640776 24303 raft_consensus.cc:686] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 1 LEADER]: Becoming Leader. State: Replica: cfa905a84e86452ca57fbc8736a29b36, State: Running, Role: LEADER
I20260808 05:08:27.640859 24303 consensus_queue.cc:237] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } }
I20260808 05:08:27.641105 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.640991 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.1:58319)
0808 05:08:27.641042 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.641079 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:08:27.641733 23274 catalog_manager.cc:5495] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1). New cstate: current_term: 1 leader_uuid: "cfa905a84e86452ca57fbc8736a29b36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cfa905a84e86452ca57fbc8736a29b36" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 35611 } health_report { overall_health: HEALTHY } } }
I20260808 05:08:27.700888 24283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.698876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37466 (local address 127.12.251.1:35611)
0808 05:08:27.698922 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:27.698924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:27.698934 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:27.698975 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:27.698975 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:27.699008 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:27.699069 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:27.699161 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.699621 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.700318 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:27.700512 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:27.700560 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:27.700649 (+ 89us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:27.700748 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:27.700794 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:27.700811 (+ 17us) server_negotiation.cc:299] Negotiation successful
0808 05:08:27.700828 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:27.701982 24097 raft_consensus.cc:1261] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Refusing update from remote peer cfa905a84e86452ca57fbc8736a29b36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:27.702052 23910 raft_consensus.cc:1261] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 1 FOLLOWER]: Refusing update from remote peer cfa905a84e86452ca57fbc8736a29b36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:27.702265 24306 consensus_queue.cc:1035] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a9a7d193bd044e6a6759009f015c0b2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:27.702399 24303 consensus_queue.cc:1035] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d31de13cd0a4929a3fe6b0783465013" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 33437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:27.703339 24301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.703241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.2:46697)
0808 05:08:27.703277 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.703309 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260808 05:08:27.703343 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.703127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.3:33283)
0808 05:08:27.703292 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.703317 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147}
I20260808 05:08:27.704295 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.704194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.1:54159)
0808 05:08:27.704234 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.704267 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 05:08:27.704717 24301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.704632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.2:48265)
0808 05:08:27.704668 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.704691 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 05:08:27.705792 24305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.705705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.1:57143)
0808 05:08:27.705745 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.705768 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:08:27.706231 24302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.706144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:35073 (local address 127.12.251.3:33469)
0808 05:08:27.706180 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.706202 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:35073: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 05:08:27.706637 23274 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:27.706712 23274 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34986:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:27.707912 23274 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f4088adbe03e4be1b6b353431c5795bc: Sending DeleteTablet for 3 replicas of tablet 118151730187422897124be1e3601c2e
I20260808 05:08:27.708427 23877 tablet_service.cc:1514] Processing DeleteTablet for tablet 118151730187422897124be1e3601c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:27 UTC) from {username='oryx', principal='oryx/127.12.251.61@KRBTEST.COM'} at 127.0.0.1:59074
I20260808 05:08:27.708498 24071 tablet_service.cc:1514] Processing DeleteTablet for tablet 118151730187422897124be1e3601c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:27 UTC) from {username='oryx', principal='oryx/127.12.251.61@KRBTEST.COM'} at 127.0.0.1:46522
I20260808 05:08:27.708559 23692 tablet_service.cc:1514] Processing DeleteTablet for tablet 118151730187422897124be1e3601c2e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:27 UTC) from {username='oryx', principal='oryx/127.12.251.61@KRBTEST.COM'} at 127.0.0.1:37452
I20260808 05:08:27.708739 24329 tablet_replica.cc:330] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36: stopping tablet replica
I20260808 05:08:27.708797 24329 raft_consensus.cc:2229] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:27.708868 24329 raft_consensus.cc:2258] T 118151730187422897124be1e3601c2e P cfa905a84e86452ca57fbc8736a29b36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:27.708945 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 23606
I20260808 05:08:27.718806 24325 tablet_replica.cc:330] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: stopping tablet replica
I20260808 05:08:27.718904 24325 raft_consensus.cc:2229] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:27.718909 24328 tablet_replica.cc:330] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: stopping tablet replica
I20260808 05:08:27.718959 24325 raft_consensus.cc:2258] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:27.719000 24328 raft_consensus.cc:2229] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:27.719048 24328 raft_consensus.cc:2258] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:27.719439 24328 ts_tablet_manager.cc:1905] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:27.720691 24325 ts_tablet_manager.cc:1905] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:27.720986 24328 ts_tablet_manager.cc:1918] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:27.721073 24328 log.cc:1196] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/118151730187422897124be1e3601c2e
I20260808 05:08:27.721372 24328 ts_tablet_manager.cc:1939] T 118151730187422897124be1e3601c2e P 9a9a7d193bd044e6a6759009f015c0b2: Deleting consensus metadata
I20260808 05:08:27.721733 23251 catalog_manager.cc:4841] TS 9a9a7d193bd044e6a6759009f015c0b2 (127.12.251.3:46515): tablet 118151730187422897124be1e3601c2e (table test-table [id=d2de290a1fc8490fa482f22f0dbb490a]) successfully deleted
I20260808 05:08:27.722087 24325 ts_tablet_manager.cc:1918] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:27.722138 24325 log.cc:1196] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/118151730187422897124be1e3601c2e
I20260808 05:08:27.722334 24325 ts_tablet_manager.cc:1939] T 118151730187422897124be1e3601c2e P 0d31de13cd0a4929a3fe6b0783465013: Deleting consensus metadata
I20260808 05:08:27.722708 23251 catalog_manager.cc:4841] TS 0d31de13cd0a4929a3fe6b0783465013 (127.12.251.2:33437): tablet 118151730187422897124be1e3601c2e (table test-table [id=d2de290a1fc8490fa482f22f0dbb490a]) successfully deleted
I20260808 05:08:27.723958 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 23793
I20260808 05:08:27.738741 24264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:27.738563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:35611 (local address 127.0.0.1:37472)
0808 05:08:27.738642 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:27.738695 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:35611: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260808 05:08:27.738941 23251 catalog_manager.cc:4584] TS cfa905a84e86452ca57fbc8736a29b36 (127.12.251.1:35611): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 118151730187422897124be1e3601c2e: Network error: Client connection negotiation failed: client connection to 127.12.251.1:35611: connect: Connection refused (error 111)
I20260808 05:08:27.743971 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 23977
I20260808 05:08:27.755779 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 23090
I20260808 05:08:27.767380 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 23348
2026-08-08T05:08:27Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (5254 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:27 dist-test-slave-bndk krb5kdc[24334](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:27 dist-test-slave-bndk krb5kdc[24334](info): set up 2 sockets
Aug 08 05:08:27 dist-test-slave-bndk krb5kdc[24334](info): commencing operation
krb5kdc: starting...
W20260808 05:08:28.903160 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:28 dist-test-slave-bndk krb5kdc[24334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:29Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab.
Entry for principal oryx/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab.
I20260808 05:08:29.031579 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36923
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab
--principal=oryx/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:36923
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:29.112283 24352 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:29.112498 24352 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:29.112527 24352 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:29.113699 24352 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:29.113740 24352 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260808 05:08:29.113756 24352 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:29.113773 24352 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:29.113788 24352 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:29.113804 24352 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:29.115331 24352 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:36923
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.62.keytab
--principal=oryx/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36923
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24352
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:29.115581 24352 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:29.115783 24352 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:29.120412 24362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:29.120419 24358 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:29.120433 24360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:29.120693 24352 server_base.cc:1034] running on GCE node
I20260808 05:08:29.120925 24352 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:29.121196 24352 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:29.122354 24352 hybrid_clock.cc:648] HybridClock initialized: now 1786165709122330 us; error 41 us; skew 500 ppm
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:29.124703 24352 init.cc:377] Logged in from keytab as oryx/127.12.251.62@KRBTEST.COM (short username oryx)
I20260808 05:08:29.125118 24352 webserver.cc:460] Webserver started at http://127.12.251.62:43881/ using document root <none> and password file <none>
I20260808 05:08:29.125370 24352 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:29.125420 24352 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:29.125550 24352 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:29.126545 24352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "0e52cde7696643a49309c10830b46c85"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "69ea4aefbd6b98addda7273c74eb08e2"
server_key_iv: "8734e758fdaf2bf32637b3d87344c15b"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.126881 24352 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "0e52cde7696643a49309c10830b46c85"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "69ea4aefbd6b98addda7273c74eb08e2"
server_key_iv: "8734e758fdaf2bf32637b3d87344c15b"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.128110 24352 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:29.128729 24374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.128886 24352 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:29.128969 24352 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "0e52cde7696643a49309c10830b46c85"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "69ea4aefbd6b98addda7273c74eb08e2"
server_key_iv: "8734e758fdaf2bf32637b3d87344c15b"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.129041 24352 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:29.157440 24352 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:29.159337 24352 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:29.159480 24352 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:29.164177 24352 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:36923
I20260808 05:08:29.164237 24461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:36923 every 8 connection(s)
I20260808 05:08:29.164549 24352 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:29.165199 24462 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:29.166189 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 24352
I20260808 05:08:29.166302 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:29.166517 13292 external_mini_cluster.cc:1428] Setting key 43c060c59741b287f78d0d165ec122c8
I20260808 05:08:29.167912 24462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Bootstrap starting.
I20260808 05:08:29.168581 24462 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:29.168855 24462 log.cc:824] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:29.169507 24462 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: No bootstrap required, opened a new log
I20260808 05:08:29.172560 24462 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e52cde7696643a49309c10830b46c85" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36923 } }
I20260808 05:08:29.172748 24462 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:29.172780 24462 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e52cde7696643a49309c10830b46c85, State: Initialized, Role: FOLLOWER
I20260808 05:08:29.172935 24462 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e52cde7696643a49309c10830b46c85" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36923 } }
I20260808 05:08:29.173000 24462 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:29.173029 24462 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:29.173066 24462 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165708, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:29.173790 24462 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e52cde7696643a49309c10830b46c85" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36923 } }
I20260808 05:08:29.173897 24462 leader_election.cc:302] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e52cde7696643a49309c10830b46c85; no voters:
I20260808 05:08:29.174063 24462 leader_election.cc:288] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:29.174108 24469 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:29.174232 24469 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [term 1 LEADER]: Becoming Leader. State: Replica: 0e52cde7696643a49309c10830b46c85, State: Running, Role: LEADER
I20260808 05:08:29.174336 24462 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:29.174327 24469 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e52cde7696643a49309c10830b46c85" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36923 } }
I20260808 05:08:29.176229 24471 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e52cde7696643a49309c10830b46c85. Latest consensus state: current_term: 1 leader_uuid: "0e52cde7696643a49309c10830b46c85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e52cde7696643a49309c10830b46c85" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36923 } } }
I20260808 05:08:29.176541 24471 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:29.176390 24470 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e52cde7696643a49309c10830b46c85" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e52cde7696643a49309c10830b46c85" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36923 } } }
I20260808 05:08:29.176687 24470 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85 [sys.catalog]: This master's current role is: LEADER
W20260808 05:08:29.176719 24486 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:08:29.176762 24486 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:08:29.176942 24491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:29.177134 24491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:29.177958 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.167041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53088 (local address 127.12.251.62:36923)
0808 05:08:29.167221 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.167230 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.167255 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:08:29.167746 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.167753 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.167802 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.167933 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.168570 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.169587 (+ 1017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.170604 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.171031 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.171134 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.173839 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.173843 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.173844 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.173854 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.175845 (+ 1991us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.176275 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.176278 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.176279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.176385 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.176631 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.176632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.176632 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.176947 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.177099 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.177595 (+ 496us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.177737 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
I20260808 05:08:29.178604 24491 catalog_manager.cc:1347] Generated new cluster ID: ffe01a5137c64d02893647c7e8d446ba
I20260808 05:08:29.178653 24491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:29.183619 24491 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:29.184141 24491 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:29.190785 24491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Generated new TSK 0
I20260808 05:08:29.190966 24491 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab.
Entry for principal oryx/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab.
I20260808 05:08:29.215839 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36923
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab
--principal=oryx/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:29.295369 24498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:29.295567 24498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:29.295589 24498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:29.296655 24498 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:29.296686 24498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:29.296705 24498 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:29.296720 24498 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:29.298182 24498 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab
--principal=oryx/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:36923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24498
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:29.298393 24498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:29.298686 24498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:29.303462 24510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:29.303537 24506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:29.303576 24498 server_base.cc:1034] running on GCE node
W20260808 05:08:29.303514 24507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:29.303776 24498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:29.304028 24498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:29.305176 24498 hybrid_clock.cc:648] HybridClock initialized: now 1786165709305158 us; error 26 us; skew 500 ppm
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:29.307443 24498 init.cc:377] Logged in from keytab as oryx/127.12.251.1@KRBTEST.COM (short username oryx)
I20260808 05:08:29.307870 24498 webserver.cc:460] Webserver started at http://127.12.251.1:33153/ using document root <none> and password file <none>
I20260808 05:08:29.308068 24498 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:29.308116 24498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:29.308238 24498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:29.309297 24498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "e2dd410424ea4c89884f670acc2b97e7"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "0757c1eec052f3e0895a83bf1ccc20f5"
server_key_iv: "45d2c4265c67a4b9ede6e3052c135bbf"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.309628 24498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "e2dd410424ea4c89884f670acc2b97e7"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "0757c1eec052f3e0895a83bf1ccc20f5"
server_key_iv: "45d2c4265c67a4b9ede6e3052c135bbf"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.310843 24498 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:29.311527 24521 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.311674 24498 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:29.311757 24498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "e2dd410424ea4c89884f670acc2b97e7"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "0757c1eec052f3e0895a83bf1ccc20f5"
server_key_iv: "45d2c4265c67a4b9ede6e3052c135bbf"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.311821 24498 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:29.320595 24498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:29.322247 24498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:29.322369 24498 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:29.322814 24498 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:29.322853 24498 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.322880 24498 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:29.322898 24498 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:29.329704 24687 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:36169 every 8 connection(s)
I20260808 05:08:29.329600 24498 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:36169
I20260808 05:08:29.330338 24498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:29.332475 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.323248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:46189 (local address 127.12.251.62:36923)
0808 05:08:29.323290 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.323292 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.323498 (+ 206us) server_negotiation.cc:407] Connection header received
0808 05:08:29.324017 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.324019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.324032 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.324091 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.324915 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.325732 (+ 817us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.327170 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.327495 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.327569 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.330004 (+ 2435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.330006 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.330006 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.330012 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.331352 (+ 1340us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.331772 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.331773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.331773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.331823 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.331995 (+ 172us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.331995 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.331995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.332089 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.332133 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.332324 (+ 191us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.332392 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:29.332577 24533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.323244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36923 (local address 127.12.251.1:46189)
0808 05:08:29.323388 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.323423 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.323904 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.324198 (+ 294us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.324202 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.324543 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:29.324815 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.324821 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.325826 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.325827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.327071 (+ 1244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.327075 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.327590 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.327590 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.327732 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.328177 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:29.328186 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:29.329921 (+ 1735us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:29.331428 (+ 1507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.331433 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.331434 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.331714 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.331861 (+ 147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.331862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.331862 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.331947 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.332127 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:29.332132 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:29.332233 (+ 101us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.332308 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.332417 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
I20260808 05:08:29.333246 24689 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36923
I20260808 05:08:29.333336 24689 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:29.333503 24689 heartbeater.cc:511] Master 127.12.251.62:36923 requested a full tablet report, sending...
I20260808 05:08:29.334091 24394 ts_manager.cc:194] Registered new tserver with Master: e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169)
I20260808 05:08:29.334944 24394 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:46189
I20260808 05:08:29.338932 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.334240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:56061 (local address 127.12.251.62:36923)
0808 05:08:29.334282 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.334284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.334410 (+ 126us) server_negotiation.cc:407] Connection header received
0808 05:08:29.334468 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.334468 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.334476 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.334520 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.334816 (+ 296us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.335339 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.336038 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.336211 (+ 173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.336263 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.336994 (+ 731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.336995 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.336995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.336999 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.338133 (+ 1134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.338414 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.338415 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.338415 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.338458 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.338598 (+ 140us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.338598 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.338599 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.338684 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.338728 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.338822 (+ 94us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.338875 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:29.338943 24697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.334182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36923 (local address 127.12.251.1:56061)
0808 05:08:29.334344 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.334355 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.334414 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.334525 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.334526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.334713 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:29.334765 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.334766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.335430 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.335430 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.335970 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.335971 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.336266 (+ 295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.336266 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.336307 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.336667 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:29.336672 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:29.336926 (+ 254us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:29.338204 (+ 1278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.338205 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.338205 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.338358 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.338507 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.338507 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.338507 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.338556 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.338725 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:29.338726 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:29.338758 (+ 32us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.338804 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.338873 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":27,"thread_start_us":69,"threads_started":1}
I20260808 05:08:29.340493 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 24498
I20260808 05:08:29.340590 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:29.340741 13292 external_mini_cluster.cc:1428] Setting key 2d7debc4ea78d9caa370a99536e60adf
WARNING: no policy specified for oryx/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab.
Entry for principal oryx/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab.
I20260808 05:08:29.363659 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36923
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab
--principal=oryx/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:29.443545 24702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:29.443725 24702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:29.443746 24702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:29.444850 24702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:29.444890 24702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:29.444908 24702 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:29.444927 24702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:29.446401 24702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab
--principal=oryx/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:36923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:29.446627 24702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:29.446832 24702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:29.451380 24711 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:29.451390 24709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:29.451401 24708 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:29.451606 24702 server_base.cc:1034] running on GCE node
I20260808 05:08:29.451818 24702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:29.452008 24702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:29.453145 24702 hybrid_clock.cc:648] HybridClock initialized: now 1786165709453134 us; error 27 us; skew 500 ppm
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:29.455483 24702 init.cc:377] Logged in from keytab as oryx/127.12.251.2@KRBTEST.COM (short username oryx)
I20260808 05:08:29.455868 24702 webserver.cc:460] Webserver started at http://127.12.251.2:37537/ using document root <none> and password file <none>
I20260808 05:08:29.456068 24702 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:29.456107 24702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:29.456195 24702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:29.457134 24702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "7fa6181cb4d14205b80e1b5277360cf9"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "12e78450b84e6d0d846af4a0b124923b"
server_key_iv: "1e337a536e8a943cbcea77bcdf3ec88e"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.457454 24702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "7fa6181cb4d14205b80e1b5277360cf9"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "12e78450b84e6d0d846af4a0b124923b"
server_key_iv: "1e337a536e8a943cbcea77bcdf3ec88e"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.458612 24702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:29.459291 24721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.459451 24702 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:29.459537 24702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "7fa6181cb4d14205b80e1b5277360cf9"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "12e78450b84e6d0d846af4a0b124923b"
server_key_iv: "1e337a536e8a943cbcea77bcdf3ec88e"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.459602 24702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:29.479741 24702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:29.481387 24702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:29.481534 24702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:29.482004 24702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:29.482043 24702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.482061 24702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:29.482072 24702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.488648 24702 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:46475
I20260808 05:08:29.488765 24890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:46475 every 8 connection(s)
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:29.489043 24702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:29.491812 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.482456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44041 (local address 127.12.251.62:36923)
0808 05:08:29.482528 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.482531 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.482705 (+ 174us) server_negotiation.cc:407] Connection header received
0808 05:08:29.483341 (+ 636us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.483342 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.483352 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.483393 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.484192 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.484964 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.486456 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.486779 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.486848 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.489458 (+ 2610us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.489459 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.489460 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.489468 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.490703 (+ 1235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.491051 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.491052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.491052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.491099 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.491269 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.491269 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.491270 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.491372 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.491420 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.491690 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.491748 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260808 05:08:29.492034 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.482405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36923 (local address 127.12.251.2:44041)
0808 05:08:29.482571 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.482618 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.483236 (+ 618us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.483479 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.483482 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.483818 (+ 336us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:29.484099 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.484105 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.485062 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.485063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.486370 (+ 1307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.486373 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.486863 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.486864 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.487004 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.487508 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:29.487520 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:29.489350 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:29.490770 (+ 1420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.490773 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.490775 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.490991 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.491144 (+ 153us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.491145 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.491145 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.491228 (+ 83us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.491448 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:29.491455 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:29.491575 (+ 120us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.491668 (+ 93us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.491807 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":68,"threads_started":1}
I20260808 05:08:29.492480 24891 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36923
I20260808 05:08:29.492561 24891 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:29.492753 24891 heartbeater.cc:511] Master 127.12.251.62:36923 requested a full tablet report, sending...
I20260808 05:08:29.493151 24395 ts_manager.cc:194] Registered new tserver with Master: 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475)
I20260808 05:08:29.493607 24395 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:44041
I20260808 05:08:29.497967 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 24702
I20260808 05:08:29.498056 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.493478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:55123 (local address 127.12.251.62:36923)
0808 05:08:29.493517 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.493519 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.493587 (+ 68us) server_negotiation.cc:407] Connection header received
0808 05:08:29.493632 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.493633 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.493642 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.493723 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.494101 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.494552 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.495197 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.495393 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.495445 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.496170 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.496171 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.496172 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.496178 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.497142 (+ 964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.497458 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.497459 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.497459 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.497505 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.497632 (+ 127us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.497633 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.497633 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.497749 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.497793 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.497931 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.497991 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:29.498085 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:29.498107 24898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.493412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36923 (local address 127.12.251.2:55123)
0808 05:08:29.493534 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.493544 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.493595 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.493766 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.493767 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.493978 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:29.494026 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.494027 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.494637 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.494638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.495130 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.495131 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.495458 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.495459 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.495523 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.495832 (+ 309us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:29.495836 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:29.496094 (+ 258us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:29.497210 (+ 1116us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.497212 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.497230 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.497401 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.497551 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.497552 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.497552 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.497599 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.497794 (+ 195us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:29.497794 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:29.497839 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.497913 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.498008 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":70,"threads_started":1}
I20260808 05:08:29.498275 13292 external_mini_cluster.cc:1428] Setting key 38cdae7a92644727ae40de8a9b0eb811
WARNING: no policy specified for oryx/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab.
Entry for principal oryx/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab.
I20260808 05:08:29.523222 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36923
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab
--principal=oryx/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:29.603771 24904 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:29.603967 24904 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:29.603999 24904 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:29.605111 24904 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:29.605150 24904 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:29.605176 24904 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260808 05:08:29.605201 24904 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:29.606722 24904 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab
--principal=oryx/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.251.62:36923
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24904
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:29.606956 24904 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:29.607160 24904 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:29.611806 24914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:29.611816 24911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:29.612001 24904 server_base.cc:1034] running on GCE node
W20260808 05:08:29.611817 24910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:29.612252 24904 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:29.612433 24904 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:29.613574 24904 hybrid_clock.cc:648] HybridClock initialized: now 1786165709613560 us; error 29 us; skew 500 ppm
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:29.615988 24904 init.cc:377] Logged in from keytab as oryx/127.12.251.3@KRBTEST.COM (short username oryx)
I20260808 05:08:29.616408 24904 webserver.cc:460] Webserver started at http://127.12.251.3:42539/ using document root <none> and password file <none>
I20260808 05:08:29.616624 24904 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:29.616668 24904 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:29.616791 24904 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:29.617858 24904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "c58e315a37b742b199f47cfb7866c63d"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "bd09bb3097ee5f5a45d98c7f44874550"
server_key_iv: "9593127587c9e5f6228b7541a69224c7"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.618171 24904 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "c58e315a37b742b199f47cfb7866c63d"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "bd09bb3097ee5f5a45d98c7f44874550"
server_key_iv: "9593127587c9e5f6228b7541a69224c7"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.619354 24904 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:29.619992 24923 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.620182 24904 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:29.620273 24904 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "c58e315a37b742b199f47cfb7866c63d"
format_stamp: "Formatted at 2026-08-08 05:08:29 on dist-test-slave-bndk"
server_key: "bd09bb3097ee5f5a45d98c7f44874550"
server_key_iv: "9593127587c9e5f6228b7541a69224c7"
server_key_version: "encryptionkey@0"
I20260808 05:08:29.620349 24904 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:29.639132 24904 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:29.641273 24904 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:29.641418 24904 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:29.641950 24904 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:29.641991 24904 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.642022 24904 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:29.642045 24904 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:29.649067 24904 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:39965
I20260808 05:08:29.649185 25084 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:39965 every 8 connection(s)
I20260808 05:08:29.649467 24904 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:29.651662 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.642342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:44823 (local address 127.12.251.62:36923)
0808 05:08:29.642407 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.642410 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.642610 (+ 200us) server_negotiation.cc:407] Connection header received
0808 05:08:29.643273 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.643274 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.643284 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.643326 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.644193 (+ 867us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.644955 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.646509 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.646765 (+ 256us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.646832 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.649198 (+ 2366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.649199 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.649200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.649208 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.650547 (+ 1339us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.650925 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.650925 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.650926 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.650972 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.651139 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.651140 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.651140 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.651237 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.651284 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.651536 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.651597 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:08:29.651793 24934 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.642313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36923 (local address 127.12.251.3:44823)
0808 05:08:29.642465 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.642517 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.643175 (+ 658us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.643436 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.643444 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.643800 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:29.644096 (+ 296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.644103 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.645063 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.645064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.646410 (+ 1346us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.646414 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.646852 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.646853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.647010 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.647451 (+ 441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:29.647462 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:29.649087 (+ 1625us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:29.650619 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.650625 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.650626 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.650865 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.651014 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.651014 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.651015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.651102 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.651282 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:29.651284 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:29.651419 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.651502 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.651618 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":70,"threads_started":1}
I20260808 05:08:29.652232 25085 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36923
I20260808 05:08:29.652311 25085 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:29.652472 25085 heartbeater.cc:511] Master 127.12.251.62:36923 requested a full tablet report, sending...
I20260808 05:08:29.652887 24394 ts_manager.cc:194] Registered new tserver with Master: c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965)
I20260808 05:08:29.653370 24394 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:44823
I20260808 05:08:29.657825 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 24904
I20260808 05:08:29.657931 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:29.658145 13292 external_mini_cluster.cc:1428] Setting key 9723911abdc475706ff3a6556ead6f7a
I20260808 05:08:29.658277 25094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.653187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36923 (local address 127.12.251.3:56137)
0808 05:08:29.653363 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.653373 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.653424 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.653542 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.653543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.653729 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:29.653797 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.653799 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.654426 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.654427 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.654931 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.654932 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.655255 (+ 323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.655256 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.655312 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.655639 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:29.655643 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:29.655911 (+ 268us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:29.657326 (+ 1415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.657327 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.657328 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.657483 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.657632 (+ 149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:29.657632 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:29.657632 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:29.657692 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:29.657976 (+ 284us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:29.657977 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:29.658025 (+ 48us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.658093 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.658191 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":88,"threads_started":1}
I20260808 05:08:29.658278 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.653274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:56137 (local address 127.12.251.62:36923)
0808 05:08:29.653317 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.653319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.653430 (+ 111us) server_negotiation.cc:407] Connection header received
0808 05:08:29.653477 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.653477 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.653487 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.653535 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.653868 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.654319 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.655003 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.655179 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.655236 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.655997 (+ 761us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.655998 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.655998 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.656004 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.657249 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.657539 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.657540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.657540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.657590 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.657737 (+ 147us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.657738 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.657738 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.657859 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.657925 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.658125 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.658192 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:08:29.659222 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:08:29.680518 24466 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:29.675501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53090 (local address 127.12.251.62:36923)
0808 05:08:29.675548 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.675550 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.675593 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:08:29.675668 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.675668 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.675679 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.675723 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.676242 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.676816 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.677622 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.677811 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.677871 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.680422 (+ 2551us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53090: BlockingRecv error: recv got EOF from 127.0.0.1:53090 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 08 05:08:29 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:29.686650 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.681167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53104 (local address 127.12.251.62:36923)
0808 05:08:29.681208 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.681209 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.681247 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:08:29.681313 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.681314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.681322 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.681357 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:29.681748 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.682198 (+ 450us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.682802 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.682964 (+ 162us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.683012 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.684759 (+ 1747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:29.684760 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:29.684760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:29.684766 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:29.685871 (+ 1105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.686156 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.686156 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.686157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.686201 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:29.686314 (+ 113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:29.686315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:29.686315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:29.686400 (+ 85us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:29.686466 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.686536 (+ 70us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.686588 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:08:29.688007 24395 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:29.689827 24395 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:29.699770 25120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.693379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:39965 (local address 127.0.0.1:54694)
0808 05:08:29.694265 (+ 886us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.694273 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.694323 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.694580 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.694583 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.694585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:29.694650 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.694651 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.695924 (+ 1273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.695925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.697261 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.697265 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.699461 (+ 2196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.699462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.699551 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.699565 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.699633 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.699687 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"mutex_wait_us":44,"thread_start_us":50,"threads_started":1}
I20260808 05:08:29.700207 25119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.693635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54694 (local address 127.12.251.3:39965)
0808 05:08:29.693841 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.693846 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.694330 (+ 484us) server_negotiation.cc:407] Connection header received
0808 05:08:29.694397 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.694400 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.694416 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.694487 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:29.694729 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.695829 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.698467 (+ 2638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.699264 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.699338 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.699422 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.700050 (+ 628us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.700095 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":174,"thread_start_us":92,"threads_started":1}
I20260808 05:08:29.700475 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.693890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39756 (local address 127.12.251.1:36169)
0808 05:08:29.694071 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.694076 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.696542 (+ 2466us) server_negotiation.cc:407] Connection header received
0808 05:08:29.696601 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.696604 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.696622 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.696697 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:29.696894 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.697927 (+ 1033us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.699108 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.699822 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.699892 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.699989 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.700337 (+ 348us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.700379 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":79,"threads_started":1}
I20260808 05:08:29.700263 25115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.693706 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36169 (local address 127.0.0.1:39756)
0808 05:08:29.696380 (+ 2674us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.696394 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.696467 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.696773 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.696774 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.696776 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:29.696824 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.696825 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.698025 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.698025 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.699020 (+ 995us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.699023 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.700027 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.700028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.700090 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.700094 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.700144 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.700185 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2656,"thread_start_us":46,"threads_started":1}
I20260808 05:08:29.704386 24592 tablet_service.cc:1467] Processing CreateTablet for tablet ca6aaadfa0cd4b099ed42ddbf81e8655 (DEFAULT_TABLE table=test-table [id=7f0287c763774137b09eec5d3dfd3bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:29.704609 24992 tablet_service.cc:1467] Processing CreateTablet for tablet ca6aaadfa0cd4b099ed42ddbf81e8655 (DEFAULT_TABLE table=test-table [id=7f0287c763774137b09eec5d3dfd3bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:29.704748 24592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca6aaadfa0cd4b099ed42ddbf81e8655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:29.704978 24992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca6aaadfa0cd4b099ed42ddbf81e8655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:29.705210 25116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.693371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46475 (local address 127.0.0.1:39242)
0808 05:08:29.694064 (+ 693us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.694110 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.694179 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.694648 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.694649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.694651 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:29.694688 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.694689 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.695942 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.695943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.698316 (+ 2373us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.698319 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.704896 (+ 6577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.704897 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.704962 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.704966 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.705096 (+ 130us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.705140 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664,"mutex_wait_us":1220,"thread_start_us":46,"threads_started":1}
I20260808 05:08:29.705679 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.693517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39242 (local address 127.12.251.2:46475)
0808 05:08:29.694441 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.694446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.694455 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:29.694499 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.694501 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.694514 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.694581 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:29.694759 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.695855 (+ 1096us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.704049 (+ 8194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.704779 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.704848 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.704932 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.705536 (+ 604us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.705580 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":884,"thread_start_us":138,"threads_started":1}
I20260808 05:08:29.706565 24793 tablet_service.cc:1467] Processing CreateTablet for tablet ca6aaadfa0cd4b099ed42ddbf81e8655 (DEFAULT_TABLE table=test-table [id=7f0287c763774137b09eec5d3dfd3bd3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:29.706905 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca6aaadfa0cd4b099ed42ddbf81e8655. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:29.708657 25122 tablet_bootstrap.cc:492] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Bootstrap starting.
I20260808 05:08:29.709022 25123 tablet_bootstrap.cc:492] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Bootstrap starting.
I20260808 05:08:29.709271 25122 tablet_bootstrap.cc:654] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:29.709708 25123 tablet_bootstrap.cc:654] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:29.709982 25122 log.cc:824] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:29.710040 25123 log.cc:824] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:29.710736 25122 tablet_bootstrap.cc:492] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: No bootstrap required, opened a new log
I20260808 05:08:29.710753 25123 tablet_bootstrap.cc:492] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: No bootstrap required, opened a new log
I20260808 05:08:29.710812 25122 ts_tablet_manager.cc:1397] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:08:29.710814 25123 ts_tablet_manager.cc:1397] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:29.711180 25129 tablet_bootstrap.cc:492] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Bootstrap starting.
I20260808 05:08:29.711786 25129 tablet_bootstrap.cc:654] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:29.712108 25129 log.cc:824] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:29.712441 25123 raft_consensus.cc:348] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.712620 25123 raft_consensus.cc:374] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:29.712664 25123 raft_consensus.cc:729] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2dd410424ea4c89884f670acc2b97e7, State: Initialized, Role: FOLLOWER
I20260808 05:08:29.712774 25123 consensus_queue.cc:260] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.712867 25129 tablet_bootstrap.cc:492] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: No bootstrap required, opened a new log
I20260808 05:08:29.712934 25129 ts_tablet_manager.cc:1397] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:29.712924 25122 raft_consensus.cc:348] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.713030 25123 ts_tablet_manager.cc:1428] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:08:29.713076 25122 raft_consensus.cc:374] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:29.713117 25122 raft_consensus.cc:729] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58e315a37b742b199f47cfb7866c63d, State: Initialized, Role: FOLLOWER
I20260808 05:08:29.713160 24689 heartbeater.cc:503] Master 127.12.251.62:36923 was elected leader, sending a full tablet report...
I20260808 05:08:29.713269 25122 consensus_queue.cc:260] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.713527 25122 ts_tablet_manager.cc:1428] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:08:29.713582 25085 heartbeater.cc:503] Master 127.12.251.62:36923 was elected leader, sending a full tablet report...
I20260808 05:08:29.714854 25129 raft_consensus.cc:348] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.714983 25129 raft_consensus.cc:374] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:29.715018 25129 raft_consensus.cc:729] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa6181cb4d14205b80e1b5277360cf9, State: Initialized, Role: FOLLOWER
I20260808 05:08:29.715126 25129 consensus_queue.cc:260] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.715377 25129 ts_tablet_manager.cc:1428] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 05:08:29.715443 24891 heartbeater.cc:503] Master 127.12.251.62:36923 was elected leader, sending a full tablet report...
W20260808 05:08:29.739630 24892 tablet.cc:2369] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:29.749394 25135 raft_consensus.cc:482] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:29.749506 25135 raft_consensus.cc:504] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.749854 25135 leader_election.cc:288] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169), c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965)
I20260808 05:08:29.752537 25119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.750164 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:45373 (local address 127.12.251.3:39965)
0808 05:08:29.750201 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.750203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.750210 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:29.750235 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.750235 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.750242 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.750285 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:29.750431 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.750895 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.751810 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.752219 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.752284 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.752294 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.752432 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.752467 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 05:08:29.752573 24734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.750018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:39965 (local address 127.12.251.2:45373)
0808 05:08:29.750067 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.750079 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.750124 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.750299 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.750300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.750302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:29.750374 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.750376 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.750962 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.750963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.751715 (+ 752us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.751717 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.752291 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.752292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.752374 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.752377 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.752421 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.752463 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":1}
I20260808 05:08:29.752568 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.750120 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:57299 (local address 127.12.251.1:36169)
0808 05:08:29.750164 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.750166 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.750265 (+ 99us) server_negotiation.cc:407] Connection header received
0808 05:08:29.750328 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.750329 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.750339 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.750388 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:29.750526 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.750992 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.751870 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.752266 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.752327 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.752335 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.752466 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.752498 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:29.752590 25136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.750027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36169 (local address 127.12.251.2:57299)
0808 05:08:29.750204 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:29.750211 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:29.750267 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:29.750389 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:29.750390 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:29.750391 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:29.750471 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.750473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.751056 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.751057 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.751800 (+ 743us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:29.751803 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.752334 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.752335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:29.752401 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.752405 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:29.752450 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:08:29.752488 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"mutex_wait_us":13,"thread_start_us":88,"threads_started":1}
I20260808 05:08:29.752890 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6aaadfa0cd4b099ed42ddbf81e8655" candidate_uuid: "7fa6181cb4d14205b80e1b5277360cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58e315a37b742b199f47cfb7866c63d" is_pre_election: true
I20260808 05:08:29.753062 25015 raft_consensus.cc:2454] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fa6181cb4d14205b80e1b5277360cf9 in term 0.
I20260808 05:08:29.753074 24622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6aaadfa0cd4b099ed42ddbf81e8655" candidate_uuid: "7fa6181cb4d14205b80e1b5277360cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2dd410424ea4c89884f670acc2b97e7" is_pre_election: true
I20260808 05:08:29.753211 24622 raft_consensus.cc:2454] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7fa6181cb4d14205b80e1b5277360cf9 in term 0.
I20260808 05:08:29.753655 24725 leader_election.cc:302] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fa6181cb4d14205b80e1b5277360cf9, c58e315a37b742b199f47cfb7866c63d; no voters:
I20260808 05:08:29.753793 25135 raft_consensus.cc:2781] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:29.753849 25135 raft_consensus.cc:482] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:29.753870 25135 raft_consensus.cc:3037] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:29.754535 25135 raft_consensus.cc:504] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.754649 25135 leader_election.cc:288] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [CANDIDATE]: Term 1 election: Requested vote from peers e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169), c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965)
I20260808 05:08:29.754796 24622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6aaadfa0cd4b099ed42ddbf81e8655" candidate_uuid: "7fa6181cb4d14205b80e1b5277360cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2dd410424ea4c89884f670acc2b97e7"
I20260808 05:08:29.754810 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca6aaadfa0cd4b099ed42ddbf81e8655" candidate_uuid: "7fa6181cb4d14205b80e1b5277360cf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58e315a37b742b199f47cfb7866c63d"
I20260808 05:08:29.754875 25015 raft_consensus.cc:3037] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:29.754879 24622 raft_consensus.cc:3037] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:29.755586 25015 raft_consensus.cc:2454] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa6181cb4d14205b80e1b5277360cf9 in term 1.
I20260808 05:08:29.755643 24622 raft_consensus.cc:2454] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7fa6181cb4d14205b80e1b5277360cf9 in term 1.
I20260808 05:08:29.755759 24725 leader_election.cc:302] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fa6181cb4d14205b80e1b5277360cf9, c58e315a37b742b199f47cfb7866c63d; no voters:
I20260808 05:08:29.755846 25135 raft_consensus.cc:2781] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:29.756000 25135 raft_consensus.cc:686] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 LEADER]: Becoming Leader. State: Replica: 7fa6181cb4d14205b80e1b5277360cf9, State: Running, Role: LEADER
I20260808 05:08:29.756088 25135 consensus_queue.cc:237] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.756865 24394 catalog_manager.cc:5495] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "7fa6181cb4d14205b80e1b5277360cf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:29.774783 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:29.772496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39250 (local address 127.12.251.2:46475)
0808 05:08:29.772547 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:29.772549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:29.772558 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:29.772613 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:29.772614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:29.772630 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:29.772689 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:29.772816 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.773313 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.774052 (+ 739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:29.774261 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:29.774316 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:29.774474 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:29.774591 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:29.774660 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:29.774696 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 05:08:29.774714 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:08:29.776455 24622 raft_consensus.cc:1261] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Refusing update from remote peer 7fa6181cb4d14205b80e1b5277360cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:29.776454 25015 raft_consensus.cc:1261] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Refusing update from remote peer 7fa6181cb4d14205b80e1b5277360cf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:29.776764 25138 consensus_queue.cc:1035] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:29.776880 25135 consensus_queue.cc:1035] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:29.779297 25144 mvcc.cc:205] Tried to move back new op lower bound from 7316134747241938944 to 7316134747161493504. Current Snapshot: MvccSnapshot[applied={T|T < 7316134747241938944}]
I20260808 05:08:29.779824 25142 mvcc.cc:205] Tried to move back new op lower bound from 7316134747241938944 to 7316134747161493504. Current Snapshot: MvccSnapshot[applied={T|T < 7316134747241938944 or (T in {7316134747241938944})}]
I20260808 05:08:29.780005 25143 mvcc.cc:205] Tried to move back new op lower bound from 7316134747241938944 to 7316134747161493504. Current Snapshot: MvccSnapshot[applied={T|T < 7316134747241938944 or (T in {7316134747241938944})}]
I20260808 05:08:29.781499 24395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:29.781579 24395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:29.782243 24395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Sending DeleteTablet for 3 replicas of tablet ca6aaadfa0cd4b099ed42ddbf81e8655
I20260808 05:08:29.782543 24992 tablet_service.cc:1514] Processing DeleteTablet for tablet ca6aaadfa0cd4b099ed42ddbf81e8655 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:29 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:54694
I20260808 05:08:29.782554 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet ca6aaadfa0cd4b099ed42ddbf81e8655 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:29 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39242
I20260808 05:08:29.782590 24592 tablet_service.cc:1514] Processing DeleteTablet for tablet ca6aaadfa0cd4b099ed42ddbf81e8655 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:29 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39756
I20260808 05:08:29.782936 24395 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53104:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260808 05:08:29.783080 25157 tablet_replica.cc:330] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: stopping tablet replica
W20260808 05:08:29.783089 24395 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:29.783170 25157 raft_consensus.cc:2229] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:29.783277 25157 raft_consensus.cc:2258] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:29.783314 25156 tablet_replica.cc:330] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: stopping tablet replica
I20260808 05:08:29.783398 25156 raft_consensus.cc:2229] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:29.783488 25156 raft_consensus.cc:2258] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:29.783922 25157 ts_tablet_manager.cc:1905] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:29.784463 24992 tablet_service.cc:1467] Processing CreateTablet for tablet 52c96b93493b4d31851fb3d75fa0391e (DEFAULT_TABLE table=test-table [id=ceb4efb186414420a3d99d843208474e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:29.784487 24793 tablet_service.cc:1467] Processing CreateTablet for tablet 52c96b93493b4d31851fb3d75fa0391e (DEFAULT_TABLE table=test-table [id=ceb4efb186414420a3d99d843208474e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:29.784590 24992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52c96b93493b4d31851fb3d75fa0391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:29.784600 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52c96b93493b4d31851fb3d75fa0391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:29.785452 25155 tablet_replica.cc:330] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: stopping tablet replica
I20260808 05:08:29.785614 25155 raft_consensus.cc:2229] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:29.785635 25157 ts_tablet_manager.cc:1918] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:29.785706 25157 log.cc:1196] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/ca6aaadfa0cd4b099ed42ddbf81e8655
I20260808 05:08:29.785782 25129 tablet_bootstrap.cc:492] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: Bootstrap starting.
I20260808 05:08:29.785897 25155 raft_consensus.cc:2258] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:29.785974 25157 ts_tablet_manager.cc:1939] T ca6aaadfa0cd4b099ed42ddbf81e8655 P e2dd410424ea4c89884f670acc2b97e7: Deleting consensus metadata
I20260808 05:08:29.786159 25122 tablet_bootstrap.cc:492] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Bootstrap starting.
I20260808 05:08:29.786223 25129 tablet_bootstrap.cc:654] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:29.786525 25155 ts_tablet_manager.cc:1905] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:29.786577 24375 catalog_manager.cc:4841] TS e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169): tablet ca6aaadfa0cd4b099ed42ddbf81e8655 (table test-table [id=7f0287c763774137b09eec5d3dfd3bd3]) successfully deleted
I20260808 05:08:29.786659 24592 tablet_service.cc:1467] Processing CreateTablet for tablet 52c96b93493b4d31851fb3d75fa0391e (DEFAULT_TABLE table=test-table [id=ceb4efb186414420a3d99d843208474e]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:29.786759 24592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 52c96b93493b4d31851fb3d75fa0391e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:29.786944 25156 ts_tablet_manager.cc:1905] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:29.787035 25129 tablet_bootstrap.cc:492] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: No bootstrap required, opened a new log
I20260808 05:08:29.787086 25129 ts_tablet_manager.cc:1397] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:29.787225 25129 raft_consensus.cc:348] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.787294 25129 raft_consensus.cc:374] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:29.787320 25129 raft_consensus.cc:729] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa6181cb4d14205b80e1b5277360cf9, State: Initialized, Role: FOLLOWER
I20260808 05:08:29.787360 25129 consensus_queue.cc:260] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.787451 25129 ts_tablet_manager.cc:1428] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:29.787846 25123 tablet_bootstrap.cc:492] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Bootstrap starting.
I20260808 05:08:29.786563 25122 tablet_bootstrap.cc:654] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:29.788254 25123 tablet_bootstrap.cc:654] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:29.788558 25156 ts_tablet_manager.cc:1918] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:29.788558 25155 ts_tablet_manager.cc:1918] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:29.788637 25155 log.cc:1196] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/ca6aaadfa0cd4b099ed42ddbf81e8655
I20260808 05:08:29.788637 25156 log.cc:1196] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/ca6aaadfa0cd4b099ed42ddbf81e8655
I20260808 05:08:29.788828 25122 tablet_bootstrap.cc:492] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: No bootstrap required, opened a new log
I20260808 05:08:29.788880 25156 ts_tablet_manager.cc:1939] T ca6aaadfa0cd4b099ed42ddbf81e8655 P 7fa6181cb4d14205b80e1b5277360cf9: Deleting consensus metadata
I20260808 05:08:29.788880 25155 ts_tablet_manager.cc:1939] T ca6aaadfa0cd4b099ed42ddbf81e8655 P c58e315a37b742b199f47cfb7866c63d: Deleting consensus metadata
I20260808 05:08:29.788873 25122 ts_tablet_manager.cc:1397] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260808 05:08:29.789045 25122 raft_consensus.cc:348] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.789101 25122 raft_consensus.cc:374] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:29.789119 25122 raft_consensus.cc:729] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58e315a37b742b199f47cfb7866c63d, State: Initialized, Role: FOLLOWER
I20260808 05:08:29.789160 25122 consensus_queue.cc:260] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.789260 25122 ts_tablet_manager.cc:1428] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:29.789273 24378 catalog_manager.cc:4841] TS 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475): tablet ca6aaadfa0cd4b099ed42ddbf81e8655 (table test-table [id=7f0287c763774137b09eec5d3dfd3bd3]) successfully deleted
I20260808 05:08:29.789273 24377 catalog_manager.cc:4841] TS c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965): tablet ca6aaadfa0cd4b099ed42ddbf81e8655 (table test-table [id=7f0287c763774137b09eec5d3dfd3bd3]) successfully deleted
I20260808 05:08:29.789621 25123 tablet_bootstrap.cc:492] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: No bootstrap required, opened a new log
I20260808 05:08:29.789672 25123 ts_tablet_manager.cc:1397] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:29.789808 25123 raft_consensus.cc:348] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.789876 25123 raft_consensus.cc:374] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:29.789902 25123 raft_consensus.cc:729] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2dd410424ea4c89884f670acc2b97e7, State: Initialized, Role: FOLLOWER
I20260808 05:08:29.789939 25123 consensus_queue.cc:260] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:29.790025 25123 ts_tablet_manager.cc:1428] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
W20260808 05:08:29.831043 24690 tablet.cc:2369] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:08:29.900040 25086 tablet.cc:2369] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:30.039232 25131 raft_consensus.cc:482] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:30.039340 25131 raft_consensus.cc:504] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.039775 25131 leader_election.cc:288] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475), c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965)
I20260808 05:08:30.043602 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.039960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:49923 (local address 127.12.251.2:46475)
0808 05:08:30.040011 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.040014 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.040136 (+ 122us) server_negotiation.cc:407] Connection header received
0808 05:08:30.040214 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.040215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.040226 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.040276 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:30.040460 (+ 184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.041184 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.042698 (+ 1514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.043244 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.043316 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.043325 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.043501 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.043536 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:08:30.043602 25119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.040032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:54355 (local address 127.12.251.3:39965)
0808 05:08:30.040073 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.040074 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.040134 (+ 60us) server_negotiation.cc:407] Connection header received
0808 05:08:30.040213 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.040214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.040225 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.040276 (+ 51us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:30.040447 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.041192 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.042704 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.043244 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.043316 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.043325 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.043491 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.043529 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:08:30.043627 25163 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.039933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:39965 (local address 127.12.251.1:54355)
0808 05:08:30.040065 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.040073 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.040140 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.040288 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.040289 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.040293 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:30.040385 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.040388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.041286 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.041287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.042614 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.042618 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.043325 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.043326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.043419 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.043424 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.043481 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.043525 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":77,"thread_start_us":53,"threads_started":1}
I20260808 05:08:30.043629 25165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.039889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46475 (local address 127.12.251.1:49923)
0808 05:08:30.040057 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.040068 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.040140 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.040289 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.040289 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.040292 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:30.040385 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.040388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.041286 (+ 898us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.041287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.042614 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.042618 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.043323 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.043324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.043419 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.043443 (+ 24us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.043492 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.043525 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":82,"thread_start_us":72,"threads_started":1}
I20260808 05:08:30.043918 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c96b93493b4d31851fb3d75fa0391e" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58e315a37b742b199f47cfb7866c63d" is_pre_election: true
I20260808 05:08:30.044027 25015 raft_consensus.cc:2454] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 0.
I20260808 05:08:30.044129 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c96b93493b4d31851fb3d75fa0391e" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9" is_pre_election: true
I20260808 05:08:30.044194 24524 leader_election.cc:302] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58e315a37b742b199f47cfb7866c63d, e2dd410424ea4c89884f670acc2b97e7; no voters:
I20260808 05:08:30.044243 24825 raft_consensus.cc:2454] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 0.
I20260808 05:08:30.044313 25131 raft_consensus.cc:2781] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:30.044360 25131 raft_consensus.cc:482] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:30.044387 25131 raft_consensus.cc:3037] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.045083 25131 raft_consensus.cc:504] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.045202 25131 leader_election.cc:288] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 election: Requested vote from peers 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475), c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965)
I20260808 05:08:30.045351 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c96b93493b4d31851fb3d75fa0391e" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58e315a37b742b199f47cfb7866c63d"
I20260808 05:08:30.045365 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "52c96b93493b4d31851fb3d75fa0391e" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9"
I20260808 05:08:30.045420 25015 raft_consensus.cc:3037] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.045428 24825 raft_consensus.cc:3037] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.046027 25015 raft_consensus.cc:2454] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 1.
I20260808 05:08:30.046128 24825 raft_consensus.cc:2454] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 1.
I20260808 05:08:30.046202 24524 leader_election.cc:302] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58e315a37b742b199f47cfb7866c63d, e2dd410424ea4c89884f670acc2b97e7; no voters:
I20260808 05:08:30.046296 25131 raft_consensus.cc:2781] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:30.046383 25131 raft_consensus.cc:686] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 1 LEADER]: Becoming Leader. State: Replica: e2dd410424ea4c89884f670acc2b97e7, State: Running, Role: LEADER
I20260808 05:08:30.046452 25131 consensus_queue.cc:237] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.047135 24395 catalog_manager.cc:5495] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1). New cstate: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } health_report { overall_health: UNKNOWN } } }
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165709, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.62@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:30.100157 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.093992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53106 (local address 127.12.251.62:36923)
0808 05:08:30.094063 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.094066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.094158 (+ 92us) server_negotiation.cc:407] Connection header received
0808 05:08:30.094233 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.094234 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.094245 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.094292 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:30.094760 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.095253 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.095905 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.096090 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.096144 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.098129 (+ 1985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:30.098130 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:30.098131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:30.098138 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:30.099209 (+ 1071us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:30.099546 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:30.099547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:30.099547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:30.099605 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:30.099765 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:30.099765 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:30.099766 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:30.099860 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:30.099904 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.100015 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.100089 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:08:30.100266 25175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.093930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36923 (local address 127.0.0.1:53106)
0808 05:08:30.094093 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.094101 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.094168 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.094302 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.094303 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.094636 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:30.094682 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.094685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.095321 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.095322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.095834 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.095836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.096148 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.096149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.096199 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.096687 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:30.096692 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:30.098040 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:30.099280 (+ 1240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:30.099287 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:30.099290 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:30.099478 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:30.099662 (+ 184us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:30.099663 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:30.099663 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:30.099720 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:30.099899 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:30.099904 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:30.099946 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.099998 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.100150 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"mutex_wait_us":63,"thread_start_us":80,"threads_started":1}
I20260808 05:08:30.102173 24395 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:53106:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260808 05:08:30.102358 24395 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:30.103677 24592 tablet_service.cc:1467] Processing CreateTablet for tablet 352f70b503d844d785cca68fd6c1cf8a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dfd96549ea3c4188a4e9c86e0cf41ec4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:30.103685 24793 tablet_service.cc:1467] Processing CreateTablet for tablet 352f70b503d844d785cca68fd6c1cf8a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dfd96549ea3c4188a4e9c86e0cf41ec4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:30.103721 24992 tablet_service.cc:1467] Processing CreateTablet for tablet 352f70b503d844d785cca68fd6c1cf8a (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=dfd96549ea3c4188a4e9c86e0cf41ec4]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260808 05:08:30.103845 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 352f70b503d844d785cca68fd6c1cf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.103844 24592 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 352f70b503d844d785cca68fd6c1cf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.103863 24992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 352f70b503d844d785cca68fd6c1cf8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.104960 25122 tablet_bootstrap.cc:492] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: Bootstrap starting.
I20260808 05:08:30.105362 25123 tablet_bootstrap.cc:492] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: Bootstrap starting.
I20260808 05:08:30.105383 25122 tablet_bootstrap.cc:654] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.105780 25123 tablet_bootstrap.cc:654] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.106101 25122 tablet_bootstrap.cc:492] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: No bootstrap required, opened a new log
I20260808 05:08:30.106154 25122 ts_tablet_manager.cc:1397] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:30.106149 25129 tablet_bootstrap.cc:492] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: Bootstrap starting.
I20260808 05:08:30.106300 25122 raft_consensus.cc:348] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.106370 25122 raft_consensus.cc:374] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.106384 25122 raft_consensus.cc:729] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58e315a37b742b199f47cfb7866c63d, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.106421 25122 consensus_queue.cc:260] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.106448 25123 tablet_bootstrap.cc:492] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: No bootstrap required, opened a new log
I20260808 05:08:30.106468 25129 tablet_bootstrap.cc:654] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.106491 25123 ts_tablet_manager.cc:1397] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:30.106518 25122 ts_tablet_manager.cc:1428] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.106575 25134 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.106642 25134 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:30.106634 25123 raft_consensus.cc:348] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.106698 25123 raft_consensus.cc:374] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.106717 25123 raft_consensus.cc:729] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2dd410424ea4c89884f670acc2b97e7, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.106758 25123 consensus_queue.cc:260] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.106839 25123 ts_tablet_manager.cc:1428] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.107021 25129 tablet_bootstrap.cc:492] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: No bootstrap required, opened a new log
I20260808 05:08:30.107059 25129 ts_tablet_manager.cc:1397] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:30.107043 25131 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.107117 25131 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:30.107157 25129 raft_consensus.cc:348] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.107208 25129 raft_consensus.cc:374] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.107219 25129 raft_consensus.cc:729] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa6181cb4d14205b80e1b5277360cf9, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.107247 25129 consensus_queue.cc:260] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.107336 25129 ts_tablet_manager.cc:1428] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.107425 25138 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.107493 25138 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:30.146263 25131 raft_consensus.cc:482] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:30.146360 25131 raft_consensus.cc:504] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.146514 25131 leader_election.cc:288] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475), c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965)
I20260808 05:08:30.146696 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "352f70b503d844d785cca68fd6c1cf8a" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9" is_pre_election: true
I20260808 05:08:30.146713 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "352f70b503d844d785cca68fd6c1cf8a" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58e315a37b742b199f47cfb7866c63d" is_pre_election: true
I20260808 05:08:30.146787 24825 raft_consensus.cc:2454] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 0.
I20260808 05:08:30.146817 25015 raft_consensus.cc:2454] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 0.
I20260808 05:08:30.146967 24526 leader_election.cc:302] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fa6181cb4d14205b80e1b5277360cf9, e2dd410424ea4c89884f670acc2b97e7; no voters:
I20260808 05:08:30.147075 25131 raft_consensus.cc:2781] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:30.147112 25131 raft_consensus.cc:482] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:30.147126 25131 raft_consensus.cc:3037] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.147764 25131 raft_consensus.cc:504] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.147873 25131 leader_election.cc:288] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 election: Requested vote from peers 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475), c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965)
I20260808 05:08:30.148025 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "352f70b503d844d785cca68fd6c1cf8a" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c58e315a37b742b199f47cfb7866c63d"
I20260808 05:08:30.148036 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "352f70b503d844d785cca68fd6c1cf8a" candidate_uuid: "e2dd410424ea4c89884f670acc2b97e7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9"
I20260808 05:08:30.148094 24825 raft_consensus.cc:3037] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.148093 25015 raft_consensus.cc:3037] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.148674 24825 raft_consensus.cc:2454] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 1.
I20260808 05:08:30.148695 25015 raft_consensus.cc:2454] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e2dd410424ea4c89884f670acc2b97e7 in term 1.
I20260808 05:08:30.148828 24524 leader_election.cc:302] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58e315a37b742b199f47cfb7866c63d, e2dd410424ea4c89884f670acc2b97e7; no voters:
I20260808 05:08:30.148943 25131 raft_consensus.cc:2781] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:30.149010 25131 raft_consensus.cc:686] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [term 1 LEADER]: Becoming Leader. State: Replica: e2dd410424ea4c89884f670acc2b97e7, State: Running, Role: LEADER
I20260808 05:08:30.149062 25131 consensus_queue.cc:237] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.149397 25166 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: TxnStatusTablet state changed. Reason: New leader e2dd410424ea4c89884f670acc2b97e7. Latest consensus state: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.149505 25166 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:30.149770 25181 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260808 05:08:30.149801 24394 catalog_manager.cc:5495] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 reported cstate change: term changed from 0 to 1, leader changed from <none> to e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1). New cstate: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:30.149892 25181 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260808 05:08:30.166671 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.163645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39770 (local address 127.12.251.1:36169)
0808 05:08:30.163682 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.163684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.163728 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:08:30.163820 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.163821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.163836 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.163892 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:30.164027 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.164694 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.165828 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.166104 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.166175 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.166352 (+ 177us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.166470 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.166543 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.166592 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.166615 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:08:30.166713 25175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.163600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36169 (local address 127.0.0.1:39770)
0808 05:08:30.163684 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.163695 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.163746 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.163912 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.163913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.163914 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:30.163967 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.163969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.164776 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.164777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.165739 (+ 962us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.165742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.166178 (+ 436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.166179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.166246 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.166264 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.166532 (+ 268us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.166538 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.166587 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.166635 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260808 05:08:30.167714 25015 raft_consensus.cc:1261] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Refusing update from remote peer e2dd410424ea4c89884f670acc2b97e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.167801 24825 raft_consensus.cc:1261] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Refusing update from remote peer e2dd410424ea4c89884f670acc2b97e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.168015 25131 consensus_queue.cc:1035] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.168149 25166 consensus_queue.cc:1035] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.168706 25134 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: TxnStatusTablet state changed. Reason: New leader e2dd410424ea4c89884f670acc2b97e7. Latest consensus state: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.168792 25134 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:30.168926 25138 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: TxnStatusTablet state changed. Reason: New leader e2dd410424ea4c89884f670acc2b97e7. Latest consensus state: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.169021 25138 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:30.169497 25131 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.169579 25131 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:30.170266 25134 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.170310 25166 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.170348 25134 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P c58e315a37b742b199f47cfb7866c63d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:30.170367 25166 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P e2dd410424ea4c89884f670acc2b97e7: This TxnStatusTablet replica's current role is: LEADER
I20260808 05:08:30.170823 25138 tablet_replica.cc:439] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e2dd410424ea4c89884f670acc2b97e7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } } }
I20260808 05:08:30.170905 25138 tablet_replica.cc:442] T 352f70b503d844d785cca68fd6c1cf8a P 7fa6181cb4d14205b80e1b5277360cf9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260808 05:08:30.173331 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.171042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39778 (local address 127.12.251.1:36169)
0808 05:08:30.171073 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.171075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.171128 (+ 53us) server_negotiation.cc:407] Connection header received
0808 05:08:30.171219 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.171221 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.171232 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.171277 (+ 45us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:30.171479 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.172023 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.172709 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.172899 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.172957 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.173080 (+ 123us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.173111 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.173149 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.173199 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.173242 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 05:08:30.178201 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.175646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:49475 (local address 127.12.251.1:36169)
0808 05:08:30.175678 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.175680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.175844 (+ 164us) server_negotiation.cc:407] Connection header received
0808 05:08:30.175957 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.175958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.175965 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.176006 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:30.176132 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.176536 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.177637 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.177804 (+ 167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.177850 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.178006 (+ 156us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.178027 (+ 21us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.178064 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.178127 (+ 63us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.178142 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":15}
I20260808 05:08:30.178583 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.175612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36169 (local address 127.12.251.1:49475)
0808 05:08:30.175784 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.175795 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.175897 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.176012 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.176013 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.176014 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:30.176080 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.176081 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.176601 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.176602 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.177568 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.177571 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.177863 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.177863 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.177926 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.177942 (+ 16us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.178077 (+ 135us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.178078 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.178125 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.178166 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":83,"threads_started":1}
I20260808 05:08:30.180472 25015 raft_consensus.cc:1261] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Refusing update from remote peer e2dd410424ea4c89884f670acc2b97e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.180552 24825 raft_consensus.cc:1261] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Refusing update from remote peer e2dd410424ea4c89884f670acc2b97e7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.180729 25131 consensus_queue.cc:1035] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.180835 25166 consensus_queue.cc:1035] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.197419 24394 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:30.197535 24394 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53104:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:30.198144 24394 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Sending DeleteTablet for 3 replicas of tablet 52c96b93493b4d31851fb3d75fa0391e
I20260808 05:08:30.198364 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet 52c96b93493b4d31851fb3d75fa0391e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39242
I20260808 05:08:30.198421 24992 tablet_service.cc:1514] Processing DeleteTablet for tablet 52c96b93493b4d31851fb3d75fa0391e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:54694
I20260808 05:08:30.198474 25156 tablet_replica.cc:330] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: stopping tablet replica
I20260808 05:08:30.198521 25155 tablet_replica.cc:330] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: stopping tablet replica
I20260808 05:08:30.198536 25156 raft_consensus.cc:2229] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:30.198565 25155 raft_consensus.cc:2229] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:30.198577 25156 raft_consensus.cc:2258] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.198598 25155 raft_consensus.cc:2258] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.198796 24591 tablet_service.cc:1514] Processing DeleteTablet for tablet 52c96b93493b4d31851fb3d75fa0391e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39756
I20260808 05:08:30.198881 25157 tablet_replica.cc:330] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: stopping tablet replica
I20260808 05:08:30.198892 25156 ts_tablet_manager.cc:1905] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.198927 25157 raft_consensus.cc:2229] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:30.199011 25157 raft_consensus.cc:2258] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.199270 25157 ts_tablet_manager.cc:1905] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.200479 25156 ts_tablet_manager.cc:1918] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:30.200577 25156 log.cc:1196] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/52c96b93493b4d31851fb3d75fa0391e
I20260808 05:08:30.200773 25157 ts_tablet_manager.cc:1918] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:30.200790 25156 ts_tablet_manager.cc:1939] T 52c96b93493b4d31851fb3d75fa0391e P 7fa6181cb4d14205b80e1b5277360cf9: Deleting consensus metadata
I20260808 05:08:30.200830 25157 log.cc:1196] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/52c96b93493b4d31851fb3d75fa0391e
I20260808 05:08:30.201017 25157 ts_tablet_manager.cc:1939] T 52c96b93493b4d31851fb3d75fa0391e P e2dd410424ea4c89884f670acc2b97e7: Deleting consensus metadata
I20260808 05:08:30.201231 24378 catalog_manager.cc:4841] TS 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475): tablet 52c96b93493b4d31851fb3d75fa0391e (table test-table [id=ceb4efb186414420a3d99d843208474e]) successfully deleted
I20260808 05:08:30.201300 24375 catalog_manager.cc:4841] TS e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169): tablet 52c96b93493b4d31851fb3d75fa0391e (table test-table [id=ceb4efb186414420a3d99d843208474e]) successfully deleted
I20260808 05:08:30.201972 25155 ts_tablet_manager.cc:1905] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.203146 25155 ts_tablet_manager.cc:1918] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:30.203204 25155 log.cc:1196] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/52c96b93493b4d31851fb3d75fa0391e
I20260808 05:08:30.203375 25155 ts_tablet_manager.cc:1939] T 52c96b93493b4d31851fb3d75fa0391e P c58e315a37b742b199f47cfb7866c63d: Deleting consensus metadata
I20260808 05:08:30.203663 24377 catalog_manager.cc:4841] TS c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965): tablet 52c96b93493b4d31851fb3d75fa0391e (table test-table [id=ceb4efb186414420a3d99d843208474e]) successfully deleted
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[24334](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:08:30.222911 24466 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:30.216697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53110 (local address 127.12.251.62:36923)
0808 05:08:30.216744 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.216746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.216850 (+ 104us) server_negotiation.cc:407] Connection header received
0808 05:08:30.216922 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.216923 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.216932 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.216980 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:30.217805 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.218299 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.219456 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.219638 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.219686 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.222842 (+ 3156us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53110: BlockingRecv error: recv got EOF from 127.0.0.1:53110 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[24334](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165710, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM
I20260808 05:08:30.230868 24466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.223690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53114 (local address 127.12.251.62:36923)
0808 05:08:30.223733 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.223734 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.223775 (+ 41us) server_negotiation.cc:407] Connection header received
0808 05:08:30.223843 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.223844 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.223853 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.223895 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:30.224410 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.224865 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.225850 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.226035 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.226088 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.228435 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:30.228436 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:30.228437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:30.228443 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:30.229759 (+ 1316us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:30.230169 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:30.230171 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:30.230171 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:30.230230 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:30.230438 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:30.230438 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:30.230439 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:30.230535 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:30.230608 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.230739 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.230799 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:30.232668 24394 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:30.232852 24394 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:30.234259 24591 tablet_service.cc:1467] Processing CreateTablet for tablet 1c70c3fa912d4737916328d77adb1247 (DEFAULT_TABLE table=test-table [id=653445854573467a86c14e9dddca0140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:30.234288 24793 tablet_service.cc:1467] Processing CreateTablet for tablet 1c70c3fa912d4737916328d77adb1247 (DEFAULT_TABLE table=test-table [id=653445854573467a86c14e9dddca0140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:30.234297 24992 tablet_service.cc:1467] Processing CreateTablet for tablet 1c70c3fa912d4737916328d77adb1247 (DEFAULT_TABLE table=test-table [id=653445854573467a86c14e9dddca0140]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:30.234404 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c70c3fa912d4737916328d77adb1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.234426 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c70c3fa912d4737916328d77adb1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.234462 24992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c70c3fa912d4737916328d77adb1247. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.235698 25129 tablet_bootstrap.cc:492] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: Bootstrap starting.
I20260808 05:08:30.235698 25122 tablet_bootstrap.cc:492] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: Bootstrap starting.
I20260808 05:08:30.235930 25123 tablet_bootstrap.cc:492] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: Bootstrap starting.
I20260808 05:08:30.236037 25129 tablet_bootstrap.cc:654] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.236068 25122 tablet_bootstrap.cc:654] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.236344 25123 tablet_bootstrap.cc:654] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.236622 25129 tablet_bootstrap.cc:492] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: No bootstrap required, opened a new log
I20260808 05:08:30.236678 25129 ts_tablet_manager.cc:1397] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:30.236794 25129 raft_consensus.cc:348] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.236866 25129 raft_consensus.cc:374] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.236886 25129 raft_consensus.cc:729] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa6181cb4d14205b80e1b5277360cf9, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.236919 25122 tablet_bootstrap.cc:492] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: No bootstrap required, opened a new log
I20260808 05:08:30.236925 25129 consensus_queue.cc:260] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.236986 25122 ts_tablet_manager.cc:1397] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:30.237010 25129 ts_tablet_manager.cc:1428] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.237150 25122 raft_consensus.cc:348] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.237268 25122 raft_consensus.cc:374] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.237298 25122 raft_consensus.cc:729] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58e315a37b742b199f47cfb7866c63d, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.237346 25122 consensus_queue.cc:260] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.237435 25122 ts_tablet_manager.cc:1428] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.237577 25123 tablet_bootstrap.cc:492] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: No bootstrap required, opened a new log
I20260808 05:08:30.237623 25123 ts_tablet_manager.cc:1397] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:30.237758 25123 raft_consensus.cc:348] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.237823 25123 raft_consensus.cc:374] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.237843 25123 raft_consensus.cc:729] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2dd410424ea4c89884f670acc2b97e7, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.237882 25123 consensus_queue.cc:260] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.237982 25123 ts_tablet_manager.cc:1428] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:30.278887 25134 raft_consensus.cc:482] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:30.278982 25134 raft_consensus.cc:504] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.279299 25134 leader_election.cc:288] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169), 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475)
I20260808 05:08:30.283048 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.279556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:46863 (local address 127.12.251.1:36169)
0808 05:08:30.279604 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.279607 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.279712 (+ 105us) server_negotiation.cc:407] Connection header received
0808 05:08:30.279806 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.279808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.279817 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.279874 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:30.280089 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.280781 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.282133 (+ 1352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.282717 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.282801 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.282811 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.282949 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.282990 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:08:30.283059 25226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.279516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36169 (local address 127.12.251.3:46863)
0808 05:08:30.279652 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.279661 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.279741 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.279903 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.279904 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.279907 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:30.279989 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.279997 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.280884 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.280884 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.282045 (+ 1161us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.282048 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.282807 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.282808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.282879 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.282884 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.282930 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.282970 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
I20260808 05:08:30.283200 25118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.279691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:55873 (local address 127.12.251.2:46475)
0808 05:08:30.279738 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.279740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.279854 (+ 114us) server_negotiation.cc:407] Connection header received
0808 05:08:30.280065 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.280066 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.280075 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.280122 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:30.280571 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.281325 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.282410 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.282771 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.282843 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.282851 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.283068 (+ 217us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.283120 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:08:30.283391 24622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c70c3fa912d4737916328d77adb1247" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2dd410424ea4c89884f670acc2b97e7" is_pre_election: true
I20260808 05:08:30.283463 25225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.279527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46475 (local address 127.12.251.3:55873)
0808 05:08:30.279780 (+ 253us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.279790 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.279974 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.280122 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.280123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.280124 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:30.280498 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.280501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.281419 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.281420 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.282340 (+ 920us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.282342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.282868 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.282870 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.282954 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.282959 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.283343 (+ 384us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.283388 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"thread_start_us":61,"threads_started":1}
I20260808 05:08:30.283481 24622 raft_consensus.cc:2454] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 0.
I20260808 05:08:30.283695 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c70c3fa912d4737916328d77adb1247" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9" is_pre_election: true
I20260808 05:08:30.283782 24825 raft_consensus.cc:2454] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 0.
I20260808 05:08:30.283742 24924 leader_election.cc:302] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58e315a37b742b199f47cfb7866c63d, e2dd410424ea4c89884f670acc2b97e7; no voters:
I20260808 05:08:30.283877 25134 raft_consensus.cc:2781] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:30.283917 25134 raft_consensus.cc:482] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:30.283941 25134 raft_consensus.cc:3037] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.284873 25134 raft_consensus.cc:504] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.285027 25134 leader_election.cc:288] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 election: Requested vote from peers e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169), 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475)
I20260808 05:08:30.285192 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c70c3fa912d4737916328d77adb1247" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9"
I20260808 05:08:30.285200 24622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c70c3fa912d4737916328d77adb1247" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2dd410424ea4c89884f670acc2b97e7"
I20260808 05:08:30.285282 24825 raft_consensus.cc:3037] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.285297 24622 raft_consensus.cc:3037] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.285877 24622 raft_consensus.cc:2454] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 1.
I20260808 05:08:30.286026 24924 leader_election.cc:302] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58e315a37b742b199f47cfb7866c63d, e2dd410424ea4c89884f670acc2b97e7; no voters:
I20260808 05:08:30.286101 25134 raft_consensus.cc:2781] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:30.286108 24825 raft_consensus.cc:2454] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 1.
I20260808 05:08:30.286197 25134 raft_consensus.cc:686] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 1 LEADER]: Becoming Leader. State: Replica: c58e315a37b742b199f47cfb7866c63d, State: Running, Role: LEADER
I20260808 05:08:30.286264 25134 consensus_queue.cc:237] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.286932 24394 catalog_manager.cc:5495] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d reported cstate change: term changed from 0 to 1, leader changed from <none> to c58e315a37b742b199f47cfb7866c63d (127.12.251.3). New cstate: current_term: 1 leader_uuid: "c58e315a37b742b199f47cfb7866c63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } health_report { overall_health: HEALTHY } } }
I20260808 05:08:30.296530 25119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.294339 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54702 (local address 127.12.251.3:39965)
0808 05:08:30.294384 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.294386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.294394 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:30.294427 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.294428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.294447 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.294507 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:30.294625 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.295080 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.295809 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.296008 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.296060 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.296207 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.296310 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.296372 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.296425 (+ 53us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.296444 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:08:30.297382 24825 raft_consensus.cc:1261] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Refusing update from remote peer c58e315a37b742b199f47cfb7866c63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.297439 24622 raft_consensus.cc:1261] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Refusing update from remote peer c58e315a37b742b199f47cfb7866c63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.297695 25228 consensus_queue.cc:1035] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.297811 25134 consensus_queue.cc:1035] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.301723 24394 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:30.301817 24394 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:30.302399 24394 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Sending DeleteTablet for 3 replicas of tablet 1c70c3fa912d4737916328d77adb1247
I20260808 05:08:30.302628 24992 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c70c3fa912d4737916328d77adb1247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:54694
I20260808 05:08:30.302641 24591 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c70c3fa912d4737916328d77adb1247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39756
I20260808 05:08:30.302711 25155 tablet_replica.cc:330] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: stopping tablet replica
I20260808 05:08:30.302719 25157 tablet_replica.cc:330] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: stopping tablet replica
I20260808 05:08:30.302752 25155 raft_consensus.cc:2229] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:30.302762 25157 raft_consensus.cc:2229] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:30.302802 25157 raft_consensus.cc:2258] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.302824 25155 raft_consensus.cc:2258] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.303057 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet 1c70c3fa912d4737916328d77adb1247 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39242
I20260808 05:08:30.303144 25156 tablet_replica.cc:330] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: stopping tablet replica
I20260808 05:08:30.303188 25156 raft_consensus.cc:2229] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:30.303223 25156 raft_consensus.cc:2258] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.303244 24394 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53114:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:30.303378 24394 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:30.303817 25155 ts_tablet_manager.cc:1905] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.304483 24591 tablet_service.cc:1467] Processing CreateTablet for tablet 87aa89581d504a818fedd1408f79ee3f (DEFAULT_TABLE table=test-table [id=fd6268ff21fc48a0a73ae342f1192971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:30.304594 24591 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87aa89581d504a818fedd1408f79ee3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.305279 25155 ts_tablet_manager.cc:1918] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:30.305346 25155 log.cc:1196] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/1c70c3fa912d4737916328d77adb1247
I20260808 05:08:30.305548 25155 ts_tablet_manager.cc:1939] T 1c70c3fa912d4737916328d77adb1247 P c58e315a37b742b199f47cfb7866c63d: Deleting consensus metadata
I20260808 05:08:30.305858 25123 tablet_bootstrap.cc:492] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7: Bootstrap starting.
I20260808 05:08:30.306144 25123 tablet_bootstrap.cc:654] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.306605 24793 tablet_service.cc:1467] Processing CreateTablet for tablet 87aa89581d504a818fedd1408f79ee3f (DEFAULT_TABLE table=test-table [id=fd6268ff21fc48a0a73ae342f1192971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:30.306638 24992 tablet_service.cc:1467] Processing CreateTablet for tablet 87aa89581d504a818fedd1408f79ee3f (DEFAULT_TABLE table=test-table [id=fd6268ff21fc48a0a73ae342f1192971]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:30.306718 24793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87aa89581d504a818fedd1408f79ee3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.306739 24992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87aa89581d504a818fedd1408f79ee3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:30.307839 24377 catalog_manager.cc:4841] TS c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965): tablet 1c70c3fa912d4737916328d77adb1247 (table test-table [id=653445854573467a86c14e9dddca0140]) successfully deleted
I20260808 05:08:30.307893 25129 tablet_bootstrap.cc:492] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: Bootstrap starting.
I20260808 05:08:30.308223 25129 tablet_bootstrap.cc:654] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.308331 25156 ts_tablet_manager.cc:1905] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.308645 25122 tablet_bootstrap.cc:492] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: Bootstrap starting.
I20260808 05:08:30.309037 25122 tablet_bootstrap.cc:654] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:30.309643 25156 ts_tablet_manager.cc:1918] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:30.309689 25156 log.cc:1196] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/1c70c3fa912d4737916328d77adb1247
I20260808 05:08:30.309811 25157 ts_tablet_manager.cc:1905] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.311115 25156 ts_tablet_manager.cc:1939] T 1c70c3fa912d4737916328d77adb1247 P 7fa6181cb4d14205b80e1b5277360cf9: Deleting consensus metadata
I20260808 05:08:30.311367 25157 ts_tablet_manager.cc:1918] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:30.311416 25157 log.cc:1196] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/1c70c3fa912d4737916328d77adb1247
I20260808 05:08:30.311468 24378 catalog_manager.cc:4841] TS 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475): tablet 1c70c3fa912d4737916328d77adb1247 (table test-table [id=653445854573467a86c14e9dddca0140]) successfully deleted
I20260808 05:08:30.311609 25157 ts_tablet_manager.cc:1939] T 1c70c3fa912d4737916328d77adb1247 P e2dd410424ea4c89884f670acc2b97e7: Deleting consensus metadata
I20260808 05:08:30.311905 24375 catalog_manager.cc:4841] TS e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169): tablet 1c70c3fa912d4737916328d77adb1247 (table test-table [id=653445854573467a86c14e9dddca0140]) successfully deleted
I20260808 05:08:30.312451 25123 tablet_bootstrap.cc:492] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7: No bootstrap required, opened a new log
I20260808 05:08:30.312502 25123 ts_tablet_manager.cc:1397] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260808 05:08:30.312556 25129 tablet_bootstrap.cc:492] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: No bootstrap required, opened a new log
I20260808 05:08:30.312597 25129 ts_tablet_manager.cc:1397] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 05:08:30.312608 25123 raft_consensus.cc:348] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.312667 25123 raft_consensus.cc:374] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.312685 25123 raft_consensus.cc:729] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2dd410424ea4c89884f670acc2b97e7, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.312690 25129 raft_consensus.cc:348] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.312722 25123 consensus_queue.cc:260] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.312745 25129 raft_consensus.cc:374] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.312764 25129 raft_consensus.cc:729] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7fa6181cb4d14205b80e1b5277360cf9, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.312799 25123 ts_tablet_manager.cc:1428] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.312803 25129 consensus_queue.cc:260] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.312882 25129 ts_tablet_manager.cc:1428] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.313566 25122 tablet_bootstrap.cc:492] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: No bootstrap required, opened a new log
I20260808 05:08:30.313618 25122 ts_tablet_manager.cc:1397] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260808 05:08:30.313768 25122 raft_consensus.cc:348] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.313845 25122 raft_consensus.cc:374] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:30.313867 25122 raft_consensus.cc:729] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c58e315a37b742b199f47cfb7866c63d, State: Initialized, Role: FOLLOWER
I20260808 05:08:30.313905 25122 consensus_queue.cc:260] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.313984 25122 ts_tablet_manager.cc:1428] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:30.392998 25134 raft_consensus.cc:482] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:30.393110 25134 raft_consensus.cc:504] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.393289 25134 leader_election.cc:288] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169), 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475)
I20260808 05:08:30.393536 24622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87aa89581d504a818fedd1408f79ee3f" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2dd410424ea4c89884f670acc2b97e7" is_pre_election: true
I20260808 05:08:30.393628 24622 raft_consensus.cc:2454] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 0.
I20260808 05:08:30.393573 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87aa89581d504a818fedd1408f79ee3f" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9" is_pre_election: true
I20260808 05:08:30.393683 24825 raft_consensus.cc:2454] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 0.
I20260808 05:08:30.393751 24924 leader_election.cc:302] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c58e315a37b742b199f47cfb7866c63d, e2dd410424ea4c89884f670acc2b97e7; no voters:
I20260808 05:08:30.393828 25134 raft_consensus.cc:2781] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:30.393850 25134 raft_consensus.cc:482] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:30.393867 25134 raft_consensus.cc:3037] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.394696 25134 raft_consensus.cc:504] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.394824 25134 leader_election.cc:288] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 election: Requested vote from peers e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169), 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475)
I20260808 05:08:30.395018 24825 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87aa89581d504a818fedd1408f79ee3f" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7fa6181cb4d14205b80e1b5277360cf9"
I20260808 05:08:30.395087 24825 raft_consensus.cc:3037] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.395061 24622 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87aa89581d504a818fedd1408f79ee3f" candidate_uuid: "c58e315a37b742b199f47cfb7866c63d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2dd410424ea4c89884f670acc2b97e7"
I20260808 05:08:30.395134 24622 raft_consensus.cc:3037] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:30.395814 24825 raft_consensus.cc:2454] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 1.
I20260808 05:08:30.395996 24928 leader_election.cc:302] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7fa6181cb4d14205b80e1b5277360cf9, c58e315a37b742b199f47cfb7866c63d; no voters:
I20260808 05:08:30.395998 24622 raft_consensus.cc:2454] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c58e315a37b742b199f47cfb7866c63d in term 1.
I20260808 05:08:30.396068 25134 raft_consensus.cc:2781] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:30.396099 25134 raft_consensus.cc:686] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 1 LEADER]: Becoming Leader. State: Replica: c58e315a37b742b199f47cfb7866c63d, State: Running, Role: LEADER
I20260808 05:08:30.396137 25134 consensus_queue.cc:237] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } }
I20260808 05:08:30.396685 24393 catalog_manager.cc:5495] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d reported cstate change: term changed from 0 to 1, leader changed from <none> to c58e315a37b742b199f47cfb7866c63d (127.12.251.3). New cstate: current_term: 1 leader_uuid: "c58e315a37b742b199f47cfb7866c63d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c58e315a37b742b199f47cfb7866c63d" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39965 } health_report { overall_health: HEALTHY } } }
I20260808 05:08:30.411705 25121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.409090 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:52577 (local address 127.12.251.1:36169)
0808 05:08:30.409142 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.409144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.409299 (+ 155us) server_negotiation.cc:407] Connection header received
0808 05:08:30.409359 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.409359 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.409369 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.409418 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:30.409577 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.410040 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.411107 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.411300 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.411350 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.411529 (+ 179us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.411555 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.411586 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.411636 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.411652 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:08:30.411765 25251 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.409026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36169 (local address 127.12.251.3:52577)
0808 05:08:30.409241 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.409252 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.409312 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.409430 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.409432 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.409434 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:30.409507 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.409509 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.410115 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.410116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.411033 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.411037 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.411369 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.411370 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.411443 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.411461 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.411589 (+ 128us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.411590 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.411634 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.411680 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":76,"threads_started":1}
I20260808 05:08:30.413626 24622 raft_consensus.cc:1261] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Refusing update from remote peer c58e315a37b742b199f47cfb7866c63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.413776 24825 raft_consensus.cc:1261] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Refusing update from remote peer c58e315a37b742b199f47cfb7866c63d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:30.413998 25134 consensus_queue.cc:1035] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2dd410424ea4c89884f670acc2b97e7" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.414114 25239 consensus_queue.cc:1035] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [LEADER]: Connected to new peer: Peer: permanent_uuid: "7fa6181cb4d14205b80e1b5277360cf9" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46475 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:30.421681 25119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.419378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:45945 (local address 127.12.251.3:39965)
0808 05:08:30.419415 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:30.419417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:30.419461 (+ 44us) server_negotiation.cc:407] Connection header received
0808 05:08:30.419526 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:30.419527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:30.419536 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:30.419569 (+ 33us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:30.419667 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.420115 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.421031 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.421314 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.421374 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.421492 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.421522 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.421567 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:30.421601 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 05:08:30.421619 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:08:30.421716 25196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.419352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:39965 (local address 127.12.251.1:45945)
0808 05:08:30.419401 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.419413 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:30.419473 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:30.419575 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:30.419576 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:30.419577 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0808 05:08:30.419616 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.419617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.420190 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.420192 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.420938 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:30.420940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:30.421372 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:30.421373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:30.421422 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:30.421428 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0808 05:08:30.421567 (+ 139us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0808 05:08:30.421568 (+ 1us) client_negotiation.cc:769] Sending connection context
0808 05:08:30.421596 (+ 28us) client_negotiation.cc:240] Negotiation successful
0808 05:08:30.421631 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 05:08:30.426689 24393 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:30.426772 24393 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53114:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:30.427280 24393 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0e52cde7696643a49309c10830b46c85: Sending DeleteTablet for 3 replicas of tablet 87aa89581d504a818fedd1408f79ee3f
I20260808 05:08:30.427513 24591 tablet_service.cc:1514] Processing DeleteTablet for tablet 87aa89581d504a818fedd1408f79ee3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39756
I20260808 05:08:30.427521 24992 tablet_service.cc:1514] Processing DeleteTablet for tablet 87aa89581d504a818fedd1408f79ee3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:54694
I20260808 05:08:30.427595 24793 tablet_service.cc:1514] Processing DeleteTablet for tablet 87aa89581d504a818fedd1408f79ee3f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:30 UTC) from {username='oryx', principal='oryx/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39242
I20260808 05:08:30.427618 25155 tablet_replica.cc:330] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: stopping tablet replica
I20260808 05:08:30.427668 25155 raft_consensus.cc:2229] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:30.427691 25156 tablet_replica.cc:330] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: stopping tablet replica
I20260808 05:08:30.427724 25155 raft_consensus.cc:2258] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.427743 25156 raft_consensus.cc:2229] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:30.427783 25156 raft_consensus.cc:2258] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.427788 25157 tablet_replica.cc:330] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7: stopping tablet replica
I20260808 05:08:30.427851 25157 raft_consensus.cc:2229] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:30.427881 25157 raft_consensus.cc:2258] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:30.428046 25156 ts_tablet_manager.cc:1905] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.428241 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 24498
I20260808 05:08:30.428284 25155 ts_tablet_manager.cc:1905] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.428288 25157 ts_tablet_manager.cc:1905] T 87aa89581d504a818fedd1408f79ee3f P e2dd410424ea4c89884f670acc2b97e7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:30.429611 25156 ts_tablet_manager.cc:1918] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:30.429611 25155 ts_tablet_manager.cc:1918] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260808 05:08:30.429663 25155 log.cc:1196] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/87aa89581d504a818fedd1408f79ee3f
I20260808 05:08:30.429663 25156 log.cc:1196] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/87aa89581d504a818fedd1408f79ee3f
I20260808 05:08:30.429867 25156 ts_tablet_manager.cc:1939] T 87aa89581d504a818fedd1408f79ee3f P 7fa6181cb4d14205b80e1b5277360cf9: Deleting consensus metadata
I20260808 05:08:30.429867 25155 ts_tablet_manager.cc:1939] T 87aa89581d504a818fedd1408f79ee3f P c58e315a37b742b199f47cfb7866c63d: Deleting consensus metadata
I20260808 05:08:30.430989 24377 catalog_manager.cc:4841] TS c58e315a37b742b199f47cfb7866c63d (127.12.251.3:39965): tablet 87aa89581d504a818fedd1408f79ee3f (table test-table [id=fd6268ff21fc48a0a73ae342f1192971]) successfully deleted
I20260808 05:08:30.430989 24378 catalog_manager.cc:4841] TS 7fa6181cb4d14205b80e1b5277360cf9 (127.12.251.2:46475): tablet 87aa89581d504a818fedd1408f79ee3f (table test-table [id=fd6268ff21fc48a0a73ae342f1192971]) successfully deleted
W20260808 05:08:30.443332 24375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:36169 (error 108)
I20260808 05:08:30.443570 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 24702
I20260808 05:08:30.448170 25256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:30.443672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36169 (local address 127.0.0.1:39780)
0808 05:08:30.448072 (+ 4400us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:30.448124 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36169: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":4380,"thread_start_us":39,"threads_started":1}
W20260808 05:08:30.451011 24375 catalog_manager.cc:4584] TS e2dd410424ea4c89884f670acc2b97e7 (127.12.251.1:36169): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 87aa89581d504a818fedd1408f79ee3f: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36169: connect: Connection refused (error 111)
I20260808 05:08:30.455482 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 24904
I20260808 05:08:30.463936 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 24352
2026-08-08T05:08:30Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2698 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[25262](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[25262](info): set up 2 sockets
Aug 08 05:08:30 dist-test-slave-bndk krb5kdc[25262](info): commencing operation
krb5kdc: starting...
W20260808 05:08:31.590047 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:31 dist-test-slave-bndk krb5kdc[25262](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165711, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:31.705471 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:38905
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:38905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:31.784663 25280 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:31.784878 25280 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:31.784909 25280 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:31.786031 25280 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:31.786072 25280 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:31.786090 25280 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:31.786106 25280 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:31.786121 25280 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:31.787546 25280 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:38905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:38905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25280
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:31.787775 25280 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:31.787971 25280 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:31.792361 25286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:31.792380 25289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:31.792404 25287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:31.792689 25280 server_base.cc:1034] running on GCE node
I20260808 05:08:31.792906 25280 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:31.793162 25280 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:31.794299 25280 hybrid_clock.cc:648] HybridClock initialized: now 1786165711794279 us; error 35 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-08T05:08:31Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1331 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:31 dist-test-slave-bndk krb5kdc[25301](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:31 dist-test-slave-bndk krb5kdc[25301](info): set up 2 sockets
Aug 08 05:08:31 dist-test-slave-bndk krb5kdc[25301](info): commencing operation
krb5kdc: starting...
W20260808 05:08:32.915285 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.093s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:32 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:33.029418 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45905
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:45905
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:33.108846 25317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:33.109055 25317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:33.109076 25317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:33.110226 25317 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:33.110271 25317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:33.110285 25317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:33.110298 25317 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:33.110321 25317 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:33.111860 25317 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:45905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:33.112099 25317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:33.112308 25317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:33.116962 25328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.117022 25325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:33.117049 25317 server_base.cc:1034] running on GCE node
W20260808 05:08:33.116976 25326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:33.117399 25317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:33.117679 25317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:33.118835 25317 hybrid_clock.cc:648] HybridClock initialized: now 1786165713118816 us; error 30 us; skew 500 ppm
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:33.121316 25317 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:33.121726 25317 webserver.cc:460] Webserver started at http://127.12.251.62:39289/ using document root <none> and password file <none>
I20260808 05:08:33.121925 25317 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:33.121964 25317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:33.122066 25317 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:33.123126 25317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "d59c8bccc0b14ff1902306c818278b03"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "0bd118e1b0e82eeb9c84c498944cd859"
server_key_iv: "3597cd888e44fb2f184010d49b46da91"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.123433 25317 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "d59c8bccc0b14ff1902306c818278b03"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "0bd118e1b0e82eeb9c84c498944cd859"
server_key_iv: "3597cd888e44fb2f184010d49b46da91"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.124608 25317 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:33.125289 25339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.125432 25317 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:33.125509 25317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "d59c8bccc0b14ff1902306c818278b03"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "0bd118e1b0e82eeb9c84c498944cd859"
server_key_iv: "3597cd888e44fb2f184010d49b46da91"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.125581 25317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:33.148006 25317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:33.149936 25317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:33.150089 25317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:33.153946 25317 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:45905
I20260808 05:08:33.153985 25416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:45905 every 8 connection(s)
I20260808 05:08:33.154358 25317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:33.155187 25417 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:33.157428 25417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Bootstrap starting.
I20260808 05:08:33.157951 25417 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:33.158190 25417 log.cc:824] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:33.158806 25417 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: No bootstrap required, opened a new log
I20260808 05:08:33.160315 25417 raft_consensus.cc:348] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.160445 25417 raft_consensus.cc:374] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:33.160467 25417 raft_consensus.cc:729] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c8bccc0b14ff1902306c818278b03, State: Initialized, Role: FOLLOWER
I20260808 05:08:33.160574 25417 consensus_queue.cc:260] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.160650 25417 raft_consensus.cc:388] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:33.160674 25417 raft_consensus.cc:482] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:33.160707 25417 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:33.161163 25417 raft_consensus.cc:504] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.161280 25417 leader_election.cc:302] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d59c8bccc0b14ff1902306c818278b03; no voters:
I20260808 05:08:33.161401 25417 leader_election.cc:288] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:33.161446 25422 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:33.161612 25417 sys_catalog.cc:564] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:33.161623 25422 raft_consensus.cc:686] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 LEADER]: Becoming Leader. State: Replica: d59c8bccc0b14ff1902306c818278b03, State: Running, Role: LEADER
I20260808 05:08:33.161731 25422 consensus_queue.cc:237] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.162132 25427 sys_catalog.cc:455] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d59c8bccc0b14ff1902306c818278b03. Latest consensus state: current_term: 1 leader_uuid: "d59c8bccc0b14ff1902306c818278b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } } }
I20260808 05:08:33.162155 25424 sys_catalog.cc:455] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d59c8bccc0b14ff1902306c818278b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } } }
I20260808 05:08:33.162238 25427 sys_catalog.cc:458] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:33.162250 25424 sys_catalog.cc:458] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:33.162436 25429 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:33.162942 25429 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:33.163718 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 25317
I20260808 05:08:33.163825 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:33.164036 13292 external_mini_cluster.cc:1428] Setting key 21fb32cb9ac204c1b6aeeeb2be66f273
I20260808 05:08:33.165542 25429 catalog_manager.cc:1347] Generated new cluster ID: 961889f0eb0f4eeeaac4abb2504aedf0
I20260808 05:08:33.165598 25429 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165712, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:33.177289 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:33.164440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39294 (local address 127.12.251.62:45905)
0808 05:08:33.165104 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:33.165114 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:33.165148 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:08:33.165282 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:33.165289 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:33.165345 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:33.165490 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:33.169378 (+ 3888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.170912 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.171668 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.172099 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.172195 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:33.174375 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:33.174378 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:33.174379 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:33.174390 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:33.175835 (+ 1445us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.176150 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.176153 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.176153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.176235 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.176409 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.176410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.176410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.176635 (+ 225us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:33.176787 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:33.176882 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 05:08:33.177024 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":609,"thread_start_us":65,"threads_started":1}
I20260808 05:08:33.187384 25429 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:33.187878 25429 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:33.191315 25429 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Generated new TSK 0
I20260808 05:08:33.191481 25429 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:33.223820 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45905
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:33.338019 25457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:33.338225 25457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:33.338248 25457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:33.339397 25457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:33.339438 25457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:33.339465 25457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:33.340898 25457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:33.341125 25457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:33.341373 25457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:33.345983 25464 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.345963 25467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.345973 25463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:33.346218 25457 server_base.cc:1034] running on GCE node
I20260808 05:08:33.346418 25457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:33.346607 25457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:33.347743 25457 hybrid_clock.cc:648] HybridClock initialized: now 1786165713347725 us; error 29 us; skew 500 ppm
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:33.350153 25457 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:33.350519 25457 webserver.cc:460] Webserver started at http://127.12.251.1:40239/ using document root <none> and password file <none>
I20260808 05:08:33.350692 25457 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:33.350730 25457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:33.350819 25457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:33.351768 25457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "f228a5b4116b4a07a54c098ca83beecb"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "b63196960f0c937e14f7412db93c77d3"
server_key_iv: "f99ceda70266cd192d3a59d30e69651d"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.352063 25457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "f228a5b4116b4a07a54c098ca83beecb"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "b63196960f0c937e14f7412db93c77d3"
server_key_iv: "f99ceda70266cd192d3a59d30e69651d"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.353183 25457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:33.353866 25478 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.354007 25457 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:33.354090 25457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "f228a5b4116b4a07a54c098ca83beecb"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "b63196960f0c937e14f7412db93c77d3"
server_key_iv: "f99ceda70266cd192d3a59d30e69651d"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.354148 25457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:33.370733 25457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:33.372782 25457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:33.372915 25457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:33.373131 25457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:33.373445 25457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:33.373483 25457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.373512 25457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:33.373528 25457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.378840 25457 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33779
I20260808 05:08:33.378902 25647 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33779 every 8 connection(s)
I20260808 05:08:33.379186 25457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:33.387444 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:33.379860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:57531 (local address 127.12.251.62:45905)
0808 05:08:33.379904 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:33.379906 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:33.380106 (+ 200us) server_negotiation.cc:407] Connection header received
0808 05:08:33.380583 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:33.380584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:33.380598 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:33.380651 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:33.381598 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.382097 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.383013 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.383198 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.383243 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:33.385169 (+ 1926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:33.385171 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:33.385171 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:33.385178 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:33.386281 (+ 1103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.386698 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.386699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.386700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.386749 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.386946 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.386946 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.386946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.387051 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:33.387099 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:33.387306 (+ 207us) server_negotiation.cc:299] Negotiation successful
0808 05:08:33.387379 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:08:33.387583 25653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:33.379824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:57531)
0808 05:08:33.380002 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:33.380045 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:33.380504 (+ 459us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:33.380714 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:33.380718 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:33.381321 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:33.381523 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:33.381529 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.382165 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.382166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:33.382936 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:33.382938 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.383252 (+ 314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.383252 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:33.383350 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:33.383748 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:33.383756 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:33.385079 (+ 1323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:33.386348 (+ 1269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:33.386354 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:33.386356 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:33.386633 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:33.386801 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:33.386802 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:33.386802 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:33.386902 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:33.387096 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:33.387100 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:33.387209 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 05:08:33.387285 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:08:33.387402 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260808 05:08:33.388082 25651 heartbeater.cc:347] Connected to a master server at 127.12.251.62:45905
I20260808 05:08:33.388180 25651 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:33.388355 25651 heartbeater.cc:511] Master 127.12.251.62:45905 requested a full tablet report, sending...
I20260808 05:08:33.388854 25365 ts_manager.cc:194] Registered new tserver with Master: f228a5b4116b4a07a54c098ca83beecb (127.12.251.1:33779)
I20260808 05:08:33.389168 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 25457
I20260808 05:08:33.389325 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:33.389506 13292 external_mini_cluster.cc:1428] Setting key 9c1bbcbc2526b9543edd6b0793165df9
I20260808 05:08:33.389562 25365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:57531
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:33.413472 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45905
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:33.492420 25658 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:33.492606 25658 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:33.492628 25658 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:33.493723 25658 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:33.493758 25658 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:33.493782 25658 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:33.495178 25658 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25658
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:33.495354 25658 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:33.495535 25658 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:33.500047 25664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.500057 25663 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:33.500190 25658 server_base.cc:1034] running on GCE node
W20260808 05:08:33.500268 25669 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:33.500525 25658 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:33.500741 25658 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:33.501873 25658 hybrid_clock.cc:648] HybridClock initialized: now 1786165713501858 us; error 29 us; skew 500 ppm
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:33.504212 25658 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:33.504576 25658 webserver.cc:460] Webserver started at http://127.12.251.2:33141/ using document root <none> and password file <none>
I20260808 05:08:33.504763 25658 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:33.504801 25658 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:33.504892 25658 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:33.505872 25658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "47efa636348446268f209d0f9fc78f2d"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "dd2bf6cda8d297dfe4f79629644245af"
server_key_iv: "4fef35a2c13c2d2424b0811b443a911a"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.506167 25658 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "47efa636348446268f209d0f9fc78f2d"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "dd2bf6cda8d297dfe4f79629644245af"
server_key_iv: "4fef35a2c13c2d2424b0811b443a911a"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.507315 25658 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:08:33.508020 25683 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.508167 25658 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:33.508244 25658 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "47efa636348446268f209d0f9fc78f2d"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "dd2bf6cda8d297dfe4f79629644245af"
server_key_iv: "4fef35a2c13c2d2424b0811b443a911a"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.508296 25658 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:33.522893 25658 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:33.524804 25658 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:33.524907 25658 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:33.525085 25658 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:33.525375 25658 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:33.525409 25658 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.525429 25658 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:33.525439 25658 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.530722 25658 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:37065
I20260808 05:08:33.530762 25849 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:37065 every 8 connection(s)
I20260808 05:08:33.531041 25658 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:33.537956 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 25658
I20260808 05:08:33.538054 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:33.538232 13292 external_mini_cluster.cc:1428] Setting key f701dce782f8bdf5ceddbc034e686f85
I20260808 05:08:33.539680 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:33.531691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:59603 (local address 127.12.251.62:45905)
0808 05:08:33.531749 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:33.531751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:33.531928 (+ 177us) server_negotiation.cc:407] Connection header received
0808 05:08:33.532421 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:33.532422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:33.532435 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:33.532506 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:33.533445 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.533947 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.534920 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.535116 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.535173 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:33.537086 (+ 1913us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:33.537088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:33.537088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:33.537095 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:33.538254 (+ 1159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.538719 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.538720 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.538720 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.538779 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.539053 (+ 274us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.539054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.539055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.539195 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:33.539264 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:33.539495 (+ 231us) server_negotiation.cc:299] Negotiation successful
0808 05:08:33.539589 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:08:33.539753 25852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:33.531646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:59603)
0808 05:08:33.531813 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:33.531851 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:33.532321 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:33.532582 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:33.532587 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:33.533140 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:33.533344 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:33.533350 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.534038 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.534039 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:33.534831 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:33.534833 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.535186 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.535187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:33.535308 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:33.535695 (+ 387us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:33.535703 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:33.537003 (+ 1300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:33.538339 (+ 1336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:33.538346 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:33.538348 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:33.538655 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:33.538850 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:33.538851 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:33.538851 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:33.538990 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:33.539261 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:33.539266 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:33.539377 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 05:08:33.539456 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:08:33.539590 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":81,"threads_started":1}
I20260808 05:08:33.540182 25850 heartbeater.cc:347] Connected to a master server at 127.12.251.62:45905
I20260808 05:08:33.540271 25850 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:33.540448 25850 heartbeater.cc:511] Master 127.12.251.62:45905 requested a full tablet report, sending...
I20260808 05:08:33.540874 25365 ts_manager.cc:194] Registered new tserver with Master: 47efa636348446268f209d0f9fc78f2d (127.12.251.2:37065)
I20260808 05:08:33.541260 25365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:59603
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:33.563701 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45905
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:33.644886 25855 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:33.645080 25855 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:33.645102 25855 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:33.646270 25855 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:33.646319 25855 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:33.646345 25855 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:33.647713 25855 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25855
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:33.647892 25855 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:33.648093 25855 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:33.652683 25865 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.652698 25862 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.652738 25863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:33.652884 25855 server_base.cc:1034] running on GCE node
I20260808 05:08:33.653165 25855 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:33.653398 25855 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:33.654534 25855 hybrid_clock.cc:648] HybridClock initialized: now 1786165713654522 us; error 24 us; skew 500 ppm
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:33.656893 25855 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:33.657366 25855 webserver.cc:460] Webserver started at http://127.12.251.3:38119/ using document root <none> and password file <none>
I20260808 05:08:33.657588 25855 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:33.657634 25855 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:33.657763 25855 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:33.658829 25855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "8687e2d718754ef69128d1482b0d5cf2"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "350be9570750b9bfa3ac97d24970199c"
server_key_iv: "195c16274574555b03f6c0abd98b0019"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.659159 25855 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "8687e2d718754ef69128d1482b0d5cf2"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "350be9570750b9bfa3ac97d24970199c"
server_key_iv: "195c16274574555b03f6c0abd98b0019"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.660367 25855 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:08:33.661018 25874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.661170 25855 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:33.661273 25855 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "8687e2d718754ef69128d1482b0d5cf2"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "350be9570750b9bfa3ac97d24970199c"
server_key_iv: "195c16274574555b03f6c0abd98b0019"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.661340 25855 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:33.675237 25855 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:33.676980 25855 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:33.677109 25855 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:33.677352 25855 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:33.677654 25855 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:33.677686 25855 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.677714 25855 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:33.677738 25855 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.683218 25855 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:41913
I20260808 05:08:33.683276 26059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:41913 every 8 connection(s)
I20260808 05:08:33.683560 25855 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:33.688623 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 25855
I20260808 05:08:33.688700 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:33.688860 13292 external_mini_cluster.cc:1428] Setting key 1f21c37d2d7a93958986bdf8635a33b6
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:33.692152 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:33.684222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:50361 (local address 127.12.251.62:45905)
0808 05:08:33.684284 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:33.684285 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:33.684442 (+ 157us) server_negotiation.cc:407] Connection header received
0808 05:08:33.684908 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:33.684909 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:33.684918 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:33.684966 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:33.685873 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.686359 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.687266 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.687452 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.687497 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:33.689447 (+ 1950us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:33.689448 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:33.689449 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:33.689457 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:33.690694 (+ 1237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.691065 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.691066 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.691066 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.691120 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:33.691402 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:33.691403 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:33.691404 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:33.691550 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:33.691591 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:33.691967 (+ 376us) server_negotiation.cc:299] Negotiation successful
0808 05:08:33.692057 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:08:33.692297 26064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:33.684178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:50361)
0808 05:08:33.684328 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:33.684368 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:33.684836 (+ 468us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:33.685028 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:33.685031 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:33.685611 (+ 580us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:33.685794 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:33.685799 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.686422 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.686423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:33.687207 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:33.687209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:33.687505 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:33.687506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:33.687598 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:33.687960 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:33.687968 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:33.689350 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:33.690769 (+ 1419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:33.690776 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:33.690778 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:33.690997 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:33.691190 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:33.691190 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:33.691191 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:33.691321 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:33.691630 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:33.691641 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:33.691803 (+ 162us) client_negotiation.cc:769] Sending connection context
0808 05:08:33.691914 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 05:08:33.692079 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260808 05:08:33.694044 26062 heartbeater.cc:347] Connected to a master server at 127.12.251.62:45905
I20260808 05:08:33.694142 26062 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:33.694332 26062 heartbeater.cc:511] Master 127.12.251.62:45905 requested a full tablet report, sending...
I20260808 05:08:33.694728 25365 ts_manager.cc:194] Registered new tserver with Master: 8687e2d718754ef69128d1482b0d5cf2 (127.12.251.3:41913)
I20260808 05:08:33.695202 25365 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:50361
I20260808 05:08:33.700381 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab.
Entry for principal oryx/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab.
WARNING: no policy specified for oryx/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab.
Entry for principal oryx/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab.
WARNING: no policy specified for oryx/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab.
Entry for principal oryx/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab.
I20260808 05:08:33.765807 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 25457
I20260808 05:08:33.774120 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 25658
I20260808 05:08:33.789511 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 25855
I20260808 05:08:33.799934 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 25317
I20260808 05:08:33.810185 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45905
--webserver_interface=127.12.251.62
--webserver_port=39289
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:45905
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:33.889170 26074 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:33.889389 26074 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:33.889417 26074 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:33.890509 26074 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:33.890548 26074 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:33.890565 26074 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:33.890581 26074 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:33.890595 26074 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:33.892042 26074 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:45905
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=39289
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26074
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:33.892270 26074 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:33.892477 26074 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:08:33.896944 26074 server_base.cc:1034] running on GCE node
W20260808 05:08:33.896909 26083 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.896894 26079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:33.896920 26080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:33.897373 26074 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:33.897646 26074 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:33.898784 26074 hybrid_clock.cc:648] HybridClock initialized: now 1786165713898767 us; error 35 us; skew 500 ppm
Aug 08 05:08:33 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165713, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:33.901201 26074 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:33.901599 26074 webserver.cc:460] Webserver started at http://127.12.251.62:39289/ using document root <none> and password file <none>
I20260808 05:08:33.901813 26074 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:33.901875 26074 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:33.903110 26074 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:33.903703 26094 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:33.903851 26074 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:33.903932 26074 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "d59c8bccc0b14ff1902306c818278b03"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "0bd118e1b0e82eeb9c84c498944cd859"
server_key_iv: "3597cd888e44fb2f184010d49b46da91"
server_key_version: "encryptionkey@0"
I20260808 05:08:33.904271 26074 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:33.911646 26074 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:33.913626 26074 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:33.913754 26074 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:33.918196 26074 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:45905
I20260808 05:08:33.918227 26176 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:45905 every 8 connection(s)
I20260808 05:08:33.918557 26074 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:33.919912 26177 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:08:33.920543 26177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Bootstrap starting.
I20260808 05:08:33.924628 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 26074
I20260808 05:08:33.924966 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:33779
--local_ip_for_outbound_sockets=127.12.251.1
--tserver_master_addrs=127.12.251.62:45905
--webserver_port=40239
--webserver_interface=127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:08:33.929328 26177 log.cc:824] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:33.930840 26177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:08:33.931093 26177 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Bootstrap complete.
I20260808 05:08:33.933140 26177 raft_consensus.cc:348] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.933409 26177 raft_consensus.cc:729] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d59c8bccc0b14ff1902306c818278b03, State: Initialized, Role: FOLLOWER
I20260808 05:08:33.933573 26177 consensus_queue.cc:260] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.933634 26177 raft_consensus.cc:388] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:33.933672 26177 raft_consensus.cc:482] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:33.933717 26177 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:08:33.934669 26177 raft_consensus.cc:504] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.934753 26177 leader_election.cc:302] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d59c8bccc0b14ff1902306c818278b03; no voters:
I20260808 05:08:33.934911 26177 leader_election.cc:288] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:08:33.934969 26181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:08:33.935091 26181 raft_consensus.cc:686] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [term 2 LEADER]: Becoming Leader. State: Replica: d59c8bccc0b14ff1902306c818278b03, State: Running, Role: LEADER
I20260808 05:08:33.935163 26177 sys_catalog.cc:564] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:33.935173 26181 consensus_queue.cc:237] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } }
I20260808 05:08:33.935525 26183 sys_catalog.cc:455] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d59c8bccc0b14ff1902306c818278b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } } }
I20260808 05:08:33.935539 26182 sys_catalog.cc:455] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d59c8bccc0b14ff1902306c818278b03. Latest consensus state: current_term: 2 leader_uuid: "d59c8bccc0b14ff1902306c818278b03" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d59c8bccc0b14ff1902306c818278b03" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45905 } } }
I20260808 05:08:33.935689 26183 sys_catalog.cc:458] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:33.935708 26182 sys_catalog.cc:458] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:33.936297 26196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:33.936779 26196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:33.936908 26196 catalog_manager.cc:1259] Loaded cluster ID: 961889f0eb0f4eeeaac4abb2504aedf0
I20260808 05:08:33.936949 26196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:33.937779 26196 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:33.937960 26196 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d59c8bccc0b14ff1902306c818278b03: Loaded TSK: 0
I20260808 05:08:33.938145 26196 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:08:34.039093 26179 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:34.039381 26179 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:34.039423 26179 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:34.041070 26179 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:34.041134 26179 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:34.041182 26179 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:34.043280 26179 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.1.keytab
--principal=oryx/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:33779
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=40239
--tserver_master_addrs=127.12.251.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:34.043562 26179 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:34.043846 26179 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:34.049052 26215 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:34.049150 26214 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:34.049242 26179 server_base.cc:1034] running on GCE node
W20260808 05:08:34.049062 26218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:34.049539 26179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:34.049815 26179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:34.051007 26179 hybrid_clock.cc:648] HybridClock initialized: now 1786165714050983 us; error 34 us; skew 500 ppm
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165714, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:34.057653 26179 init.cc:377] Logged in from keytab as oryx/127.12.251.1@KRBTEST.COM (short username oryx)
I20260808 05:08:34.058164 26179 webserver.cc:460] Webserver started at http://127.12.251.1:40239/ using document root <none> and password file <none>
I20260808 05:08:34.058436 26179 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:34.058525 26179 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:34.059966 26179 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:34.060563 26229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.060724 26179 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.060827 26179 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "f228a5b4116b4a07a54c098ca83beecb"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "b63196960f0c937e14f7412db93c77d3"
server_key_iv: "f99ceda70266cd192d3a59d30e69651d"
server_key_version: "encryptionkey@0"
I20260808 05:08:34.061287 26179 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:34.072293 26179 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:34.074577 26179 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:34.074730 26179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:34.074975 26179 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:34.075350 26179 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:34.075400 26179 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.075435 26179 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:34.075459 26179 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.082808 26179 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33779
I20260808 05:08:34.082846 26412 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33779 every 8 connection(s)
I20260808 05:08:34.083235 26179 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.090881 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 26179
I20260808 05:08:34.091192 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:37065
--local_ip_for_outbound_sockets=127.12.251.2
--tserver_master_addrs=127.12.251.62:45905
--webserver_port=33141
--webserver_interface=127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:08:34.091401 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.084009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:58737)
0808 05:08:34.084175 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.084217 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.084713 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.085131 (+ 418us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.085135 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.085733 (+ 598us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.085919 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.085924 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.087019 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.087020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.087790 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.087793 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.088360 (+ 567us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.088361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.088486 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.089010 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.089018 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.091182 (+ 2164us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":77,"threads_started":1}
W20260808 05:08:34.091596 26414 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:45905 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.251.62:45905: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
W20260808 05:08:34.092134 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.084097 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:58737 (local address 127.12.251.62:45905)
0808 05:08:34.084290 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.084298 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.084338 (+ 40us) server_negotiation.cc:407] Connection header received
0808 05:08:34.084905 (+ 567us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.084911 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.084962 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.085074 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.086042 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.086918 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.087875 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.088280 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.088372 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.091946 (+ 3574us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:58737: BlockingRecv error: recv got EOF from 127.12.251.1:58737 (error 108)
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":83,"threads_started":1}
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.096566 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.091798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:56973)
0808 05:08:34.091995 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.092006 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.092042 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.092396 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.092396 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.092510 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.092552 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.092554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.093405 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.093407 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.094224 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.094226 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.094546 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.094547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.094612 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.095003 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.095008 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.096507 (+ 1499us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180}
W20260808 05:08:34.096638 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.091882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:56973 (local address 127.12.251.62:45905)
0808 05:08:34.092269 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.092271 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.092278 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:34.092297 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.092298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.092308 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.092357 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.092621 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.093302 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.094300 (+ 998us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.094481 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.094534 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.096587 (+ 2053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:56973: BlockingRecv error: recv got EOF from 127.12.251.1:56973 (error 108)
Metrics: {"server-negotiator.queue_time_us":373,"thread_start_us":78,"threads_started":1}
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.100829 26417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.096807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:50369)
0808 05:08:34.097031 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.097040 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.097083 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.097198 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.097199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.097337 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.097363 (+ 26us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.097364 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.097908 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.097909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.098380 (+ 471us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.098382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.098674 (+ 292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.098675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.098724 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.099177 (+ 453us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.099182 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.100770 (+ 1588us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213}
W20260808 05:08:34.100939 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.096860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:50369 (local address 127.12.251.62:45905)
0808 05:08:34.096894 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.096896 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.097083 (+ 187us) server_negotiation.cc:407] Connection header received
0808 05:08:34.097136 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.097137 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.097146 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.097190 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.097422 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.097845 (+ 423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.098447 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.098619 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.098671 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.100886 (+ 2215us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:50369: BlockingRecv error: recv got EOF from 127.12.251.1:50369 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 05:08:34.101132 26414 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:08:34.179536 26420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:34.179742 26420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:34.179764 26420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:34.180853 26420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:34.180887 26420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:34.180912 26420 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:34.182310 26420 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.2.keytab
--principal=oryx/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:37065
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=33141
--tserver_master_addrs=127.12.251.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26420
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:34.182505 26420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:34.182678 26420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:34.187318 26431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:34.187330 26432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:34.187440 26420 server_base.cc:1034] running on GCE node
W20260808 05:08:34.187369 26434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:34.187844 26420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:34.188047 26420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:34.189195 26420 hybrid_clock.cc:648] HybridClock initialized: now 1786165714189178 us; error 31 us; skew 500 ppm
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165714, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:34.191798 26420 init.cc:377] Logged in from keytab as oryx/127.12.251.2@KRBTEST.COM (short username oryx)
I20260808 05:08:34.192198 26420 webserver.cc:460] Webserver started at http://127.12.251.2:33141/ using document root <none> and password file <none>
I20260808 05:08:34.192410 26420 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:34.192468 26420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:34.193783 26420 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260808 05:08:34.194312 26443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.194486 26420 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.194564 26420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "47efa636348446268f209d0f9fc78f2d"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "dd2bf6cda8d297dfe4f79629644245af"
server_key_iv: "4fef35a2c13c2d2424b0811b443a911a"
server_key_version: "encryptionkey@0"
I20260808 05:08:34.194886 26420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:34.227157 26420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:34.229036 26420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:34.229171 26420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:34.229449 26420 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:34.229760 26420 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:34.229795 26420 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.229820 26420 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:34.229842 26420 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.235360 26420 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:37065
I20260808 05:08:34.235415 26620 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:37065 every 8 connection(s)
I20260808 05:08:34.235765 26420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:34.238131 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 26420
I20260808 05:08:34.238420 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:41913
--local_ip_for_outbound_sockets=127.12.251.3
--tserver_master_addrs=127.12.251.62:45905
--webserver_port=38119
--webserver_interface=127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:40701
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
W20260808 05:08:34.243076 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.236476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:43019 (local address 127.12.251.62:45905)
0808 05:08:34.236519 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.236521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.236720 (+ 199us) server_negotiation.cc:407] Connection header received
0808 05:08:34.237276 (+ 556us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.237278 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.237351 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.237404 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.238374 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.239012 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.239990 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.240184 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.240241 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.243022 (+ 2781us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:43019: BlockingRecv error: recv got EOF from 127.12.251.2:43019 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:34.243108 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.236465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:43019)
0808 05:08:34.236606 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.236641 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.237161 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.237473 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.237476 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.238035 (+ 559us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.238251 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.238258 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.239094 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.239095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.239895 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.239897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.240253 (+ 356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.240254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.240377 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.240834 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.240843 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.242914 (+ 2071us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":79,"threads_started":1}
W20260808 05:08:34.243619 26622 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:45905 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.251.62:45905: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.248322 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.243840 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:42369)
0808 05:08:34.243959 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.243972 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.244031 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.244155 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.244155 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.244294 (+ 139us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.244349 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.244351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.245003 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.245004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.245785 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.245789 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.246127 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.246128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.246195 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.246550 (+ 355us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.246555 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.248274 (+ 1719us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":99}
W20260808 05:08:34.248449 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.243908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:42369 (local address 127.12.251.62:45905)
0808 05:08:34.243964 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.243966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.244020 (+ 54us) server_negotiation.cc:407] Connection header received
0808 05:08:34.244093 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.244094 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.244101 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.244134 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.244447 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.244926 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.245876 (+ 950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.246058 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.246111 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.248387 (+ 2276us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:42369: BlockingRecv error: recv got EOF from 127.12.251.2:42369 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.252750 26625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.248669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:52841)
0808 05:08:34.248722 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.248735 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.248779 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.248906 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.248907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.249039 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.249072 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.249074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.249672 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.249673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.250470 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.250472 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.250763 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.250764 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.250827 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.251143 (+ 316us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.251147 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.252694 (+ 1547us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 05:08:34.252859 26622 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:08:34.252871 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.248721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:52841 (local address 127.12.251.62:45905)
0808 05:08:34.248765 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.248766 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.248775 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:34.248839 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.248840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.248847 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.248889 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.249135 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.249606 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.250540 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.250709 (+ 169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.250752 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.252774 (+ 2022us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:52841: BlockingRecv error: recv got EOF from 127.12.251.2:52841 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260808 05:08:34.321978 26627 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:34.322177 26627 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:34.322208 26627 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:34.323349 26627 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:34.323393 26627 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:34.323427 26627 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:34.324869 26627 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:40701
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/krb5kdc/oryx_127.12.251.3.keytab
--principal=oryx/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:41913
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=38119
--tserver_master_addrs=127.12.251.62:45905
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26627
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:34.325105 26627 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:34.325423 26627 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:34.330063 26641 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:34.330035 26636 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:34.330084 26637 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:34.330247 26627 server_base.cc:1034] running on GCE node
I20260808 05:08:34.330507 26627 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:34.330749 26627 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:34.331892 26627 hybrid_clock.cc:648] HybridClock initialized: now 1786165714331876 us; error 27 us; skew 500 ppm
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165714, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:34.334304 26627 init.cc:377] Logged in from keytab as oryx/127.12.251.3@KRBTEST.COM (short username oryx)
I20260808 05:08:34.334753 26627 webserver.cc:460] Webserver started at http://127.12.251.3:38119/ using document root <none> and password file <none>
I20260808 05:08:34.335027 26627 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:34.335103 26627 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:34.336480 26627 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:08:34.337013 26653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.337155 26627 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:34.337261 26627 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "8687e2d718754ef69128d1482b0d5cf2"
format_stamp: "Formatted at 2026-08-08 05:08:33 on dist-test-slave-bndk"
server_key: "350be9570750b9bfa3ac97d24970199c"
server_key_iv: "195c16274574555b03f6c0abd98b0019"
server_key_version: "encryptionkey@0"
I20260808 05:08:34.337599 26627 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:34.349628 26627 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:34.351204 26627 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:34.351352 26627 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:34.351557 26627 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:34.351830 26627 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:34.351863 26627 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.351891 26627 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:34.351915 26627 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:34.357460 26627 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:41913
I20260808 05:08:34.357509 26817 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:41913 every 8 connection(s)
I20260808 05:08:34.357817 26627 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.363837 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 26627
W20260808 05:08:34.364485 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.358464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:44347 (local address 127.12.251.62:45905)
0808 05:08:34.358547 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.358549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.358683 (+ 134us) server_negotiation.cc:407] Connection header received
0808 05:08:34.359144 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.359145 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.359155 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.359204 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.360054 (+ 850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.360534 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.361512 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.361691 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.361738 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.364422 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:44347: BlockingRecv error: recv got EOF from 127.12.251.3:44347 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260808 05:08:34.364557 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.358430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:44347)
0808 05:08:34.358581 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.358616 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.359069 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.359256 (+ 187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.359259 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.359793 (+ 534us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.359987 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.359992 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.360593 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.360594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.361440 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.361443 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.361745 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.361746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.361836 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.362256 (+ 420us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.362264 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.364344 (+ 2080us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":81,"threads_started":1}
W20260808 05:08:34.364817 26821 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:45905 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.251.62:45905: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.369722 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.365037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:44815)
0808 05:08:34.365147 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.365158 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.365210 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.365351 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.365352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.365492 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.365535 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.365537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.366322 (+ 785us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.366323 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.367108 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.367111 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.367527 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.367528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.367592 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.368036 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.368041 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.369666 (+ 1625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":92}
W20260808 05:08:34.369804 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.365098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:44815 (local address 127.12.251.62:45905)
0808 05:08:34.365146 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.365147 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.365196 (+ 49us) server_negotiation.cc:407] Connection header received
0808 05:08:34.365281 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.365282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.365290 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.365332 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.365596 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.366264 (+ 668us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.367181 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.367456 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.367513 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.369751 (+ 2238us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:44815: BlockingRecv error: recv got EOF from 127.12.251.3:44815 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:08:34.371881 26419 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.364360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39306 (local address 127.12.251.62:45905)
0808 05:08:34.364426 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.364428 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.364438 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:34.364493 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.364494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.364505 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.364574 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.365425 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.366160 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.367206 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.367489 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.367539 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.368784 (+ 1245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:34.368789 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:34.368790 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:34.368800 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:34.370621 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:34.370931 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:34.370934 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:34.370934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:34.371030 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:34.371207 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:34.371207 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:34.371208 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:34.371440 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:34.371586 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:34.371686 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 05:08:34.371789 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:34 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:34.373733 26823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:34.370034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:47297)
0808 05:08:34.370085 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:34.370096 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:34.370138 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:34.370236 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:34.370236 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:34.370363 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:34.370393 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.370395 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.370935 (+ 540us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.370936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.371415 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:34.371417 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.371722 (+ 305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.371723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:34.371771 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.372133 (+ 362us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:34.372138 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:34.373678 (+ 1540us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 05:08:34.373798 26418 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:34.370084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:47297 (local address 127.12.251.62:45905)
0808 05:08:34.370117 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:34.370119 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:34.370127 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:34.370183 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:34.370184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:34.370190 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:34.370230 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:34.370461 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.370867 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.371485 (+ 618us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:34.371668 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:34.371718 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:34.373751 (+ 2033us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:47297: BlockingRecv error: recv got EOF from 127.12.251.3:47297 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 05:08:34.373836 26821 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 05:08:35 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:35 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:35.105770 26825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:35.101446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:46791)
0808 05:08:35.101574 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:35.101586 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:35.101642 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:35.101774 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:35.101775 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:35.101931 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:35.101982 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:35.101983 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.102574 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.102574 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:35.103138 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:35.103140 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.103415 (+ 275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.103415 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:35.103456 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:35.103927 (+ 471us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:35.103930 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:35.105678 (+ 1748us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":59,"threads_started":1}
W20260808 05:08:35.105852 26826 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:35.101504 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:46791 (local address 127.12.251.62:45905)
0808 05:08:35.101630 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:35.101632 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:35.101641 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:35.101697 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:35.101697 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:35.101708 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:35.101772 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:35.102033 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.102520 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.103186 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.103368 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.103412 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:35.105778 (+ 2366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:46791: BlockingRecv error: recv got EOF from 127.12.251.1:46791 (error 108)
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":66,"threads_started":1}
Aug 08 05:08:35 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:35 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:35.257687 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:35.253207 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:34553)
0808 05:08:35.253345 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:35.253356 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:35.253409 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:35.253525 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:35.253526 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:35.253678 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:35.253727 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:35.253728 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.254343 (+ 615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.254345 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:35.255059 (+ 714us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:35.255062 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.255387 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.255388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:35.255442 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:35.255863 (+ 421us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:35.255869 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:35.257602 (+ 1733us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":61,"threads_started":1}
W20260808 05:08:35.257766 26826 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:35.253284 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:34553 (local address 127.12.251.62:45905)
0808 05:08:35.253345 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:35.253347 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:35.253415 (+ 68us) server_negotiation.cc:407] Connection header received
0808 05:08:35.253451 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:35.253452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:35.253462 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:35.253517 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:35.253776 (+ 259us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.254258 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.255133 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.255326 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.255380 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:35.257713 (+ 2333us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:34553: BlockingRecv error: recv got EOF from 127.12.251.2:34553 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 05:08:35 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:35 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:35.378580 26829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:35.374180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:51447)
0808 05:08:35.374325 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:35.374337 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:35.374404 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:35.374528 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:35.374529 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:35.374711 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:35.374758 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:35.374759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.375402 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.375404 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:35.375972 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:35.375974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.376299 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.376300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:35.376355 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:35.376765 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:35.376770 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:35.378506 (+ 1736us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
W20260808 05:08:35.378660 26826 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:35.374261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:51447 (local address 127.12.251.62:45905)
0808 05:08:35.374326 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:35.374328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:35.374385 (+ 57us) server_negotiation.cc:407] Connection header received
0808 05:08:35.374454 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:35.374455 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:35.374470 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:35.374513 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:35.374829 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.375331 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.376050 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:35.376240 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:35.376295 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:35.378597 (+ 2302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:51447: BlockingRecv error: recv got EOF from 127.12.251.3:51447 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 05:08:36 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:36 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:36.110760 26832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:36.106275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:36211)
0808 05:08:36.106418 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:36.106430 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:36.106492 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:36.106625 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:36.106626 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:36.106792 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:36.106843 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:36.106845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.107628 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.107629 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:36.108227 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:36.108230 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.108526 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.108526 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:36.108564 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:36.109038 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:36.109043 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:36.110699 (+ 1656us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
W20260808 05:08:36.110867 26833 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:36.106322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:36211 (local address 127.12.251.62:45905)
0808 05:08:36.106463 (+ 141us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:36.106464 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:36.106474 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:36.106541 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:36.106542 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:36.106553 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:36.106614 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:36.106897 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.107569 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.108289 (+ 720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.108478 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.108521 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:36.110796 (+ 2275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:36211: BlockingRecv error: recv got EOF from 127.12.251.1:36211 (error 108)
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":86,"threads_started":1}
Aug 08 05:08:36 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:36 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:36.262552 26834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:36.258127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:52251)
0808 05:08:36.258280 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:36.258290 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:36.258357 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:36.258470 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:36.258470 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:36.258638 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:36.258689 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:36.258690 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.259294 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.259295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:36.259837 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:36.259839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.260161 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.260162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:36.260197 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:36.260667 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:36.260673 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:36.262489 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":83,"threads_started":1}
W20260808 05:08:36.262639 26833 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:36.258195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:52251 (local address 127.12.251.62:45905)
0808 05:08:36.258250 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:36.258252 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:36.258348 (+ 96us) server_negotiation.cc:407] Connection header received
0808 05:08:36.258397 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:36.258398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:36.258409 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:36.258460 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:36.258734 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.259227 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.259906 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.260107 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.260159 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:36.262578 (+ 2419us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:52251: BlockingRecv error: recv got EOF from 127.12.251.2:52251 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 05:08:36 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:36 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:36.383320 26835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:36.379006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:47153)
0808 05:08:36.379150 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:36.379162 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:36.379228 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:36.379352 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:36.379353 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:36.379536 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:36.379585 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:36.379587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.380223 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.380224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:36.380748 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:36.380750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.381087 (+ 337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.381088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:36.381143 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:36.381580 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:36.381584 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:36.383241 (+ 1657us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":63,"threads_started":1}
W20260808 05:08:36.383392 26833 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:36.379105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:47153 (local address 127.12.251.62:45905)
0808 05:08:36.379155 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:36.379157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:36.379207 (+ 50us) server_negotiation.cc:407] Connection header received
0808 05:08:36.379285 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:36.379286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:36.379299 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:36.379337 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:36.379651 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.380148 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.380817 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:36.381024 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:36.381079 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:36.383337 (+ 2258us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:47153: BlockingRecv error: recv got EOF from 127.12.251.3:47153 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 05:08:37 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:37 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:37.115568 26836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:37.111201 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:51045)
0808 05:08:37.111349 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:37.111363 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:37.111422 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:37.111578 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:37.111579 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:37.111747 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:37.111800 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:37.111802 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.112460 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.112460 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:37.112978 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:37.112979 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.113313 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.113314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:37.113373 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:37.113835 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:37.113841 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:37.115507 (+ 1666us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":62,"threads_started":1}
W20260808 05:08:37.115684 26837 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:37.111267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:51045 (local address 127.12.251.62:45905)
0808 05:08:37.111446 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:37.111447 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:37.111456 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:37.111478 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:37.111478 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:37.111491 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:37.111556 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:37.111884 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.112396 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.113033 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.113232 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.113295 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:37.115611 (+ 2316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:51045: BlockingRecv error: recv got EOF from 127.12.251.1:51045 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":82,"threads_started":1}
Aug 08 05:08:37 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:37 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:37.267308 26838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:37.263004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:47637)
0808 05:08:37.263148 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:37.263158 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:37.263213 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:37.263328 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:37.263329 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:37.263504 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:37.263553 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:37.263555 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.264141 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.264142 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:37.264653 (+ 511us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:37.264655 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.265026 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.265028 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:37.265083 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:37.265594 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:37.265598 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:37.267247 (+ 1649us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":85,"threads_started":1}
W20260808 05:08:37.267408 26837 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:37.263052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:47637 (local address 127.12.251.62:45905)
0808 05:08:37.263110 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:37.263112 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:37.263206 (+ 94us) server_negotiation.cc:407] Connection header received
0808 05:08:37.263261 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:37.263262 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:37.263272 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:37.263321 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:37.263599 (+ 278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.264090 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.264727 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.264920 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.264986 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:37.267341 (+ 2355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:47637: BlockingRecv error: recv got EOF from 127.12.251.2:47637 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 05:08:37 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:37 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:37.388378 26839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:37.383778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:51397)
0808 05:08:37.383940 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:37.383959 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:37.384027 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:37.384158 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:37.384159 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:37.384339 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:37.384387 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:37.384389 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.385040 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.385042 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:37.385615 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:37.385617 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.385935 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.385936 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:37.386001 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:37.386395 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:37.386399 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:37.388297 (+ 1898us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":84,"threads_started":1}
W20260808 05:08:37.388456 26837 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:37.383869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:51397 (local address 127.12.251.62:45905)
0808 05:08:37.383932 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:37.383934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:37.384008 (+ 74us) server_negotiation.cc:407] Connection header received
0808 05:08:37.384078 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:37.384078 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:37.384092 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:37.384141 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:37.384472 (+ 331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.384966 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.385691 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:37.385875 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:37.385929 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:37.388392 (+ 2463us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:51397: BlockingRecv error: recv got EOF from 127.12.251.3:51397 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 05:08:38 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:38 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:38.120301 26840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:38.116000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:45237)
0808 05:08:38.116138 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:38.116150 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:38.116206 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:38.116332 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:38.116333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:38.116504 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:38.116556 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:38.116557 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.117201 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.117201 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:38.117774 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:38.117777 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.118094 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.118095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:38.118143 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:38.118550 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:38.118554 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:38.120240 (+ 1686us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":75,"threads_started":1}
W20260808 05:08:38.120406 26842 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:38.116050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:45237 (local address 127.12.251.62:45905)
0808 05:08:38.116161 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:38.116163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:38.116196 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:08:38.116256 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:38.116257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:38.116267 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:38.116322 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:38.116619 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.117142 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.117835 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.118032 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.118075 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:38.120336 (+ 2261us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:45237: BlockingRecv error: recv got EOF from 127.12.251.1:45237 (error 108)
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":50,"threads_started":1}
Aug 08 05:08:38 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:38 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:38.272187 26843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:38.267784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:37665)
0808 05:08:38.267978 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:38.267989 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:38.268049 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:38.268168 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:38.268169 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:38.268347 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:38.268399 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:38.268400 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.269031 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.269033 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:38.269601 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:38.269603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.269920 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.269921 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:38.269961 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:38.270412 (+ 451us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:38.270417 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:38.272128 (+ 1711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":120,"threads_started":1}
W20260808 05:08:38.272286 26842 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:38.267853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:37665 (local address 127.12.251.62:45905)
0808 05:08:38.267908 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:38.267910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:38.268041 (+ 131us) server_negotiation.cc:407] Connection header received
0808 05:08:38.268105 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:38.268105 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:38.268117 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:38.268153 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:38.268452 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.268936 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.269672 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.269867 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.269916 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:38.272217 (+ 2301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:37665: BlockingRecv error: recv got EOF from 127.12.251.2:37665 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 05:08:38 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:38 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:38.393203 26844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:38.388857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:36837)
0808 05:08:38.389002 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:38.389013 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:38.389083 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:38.389235 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:38.389236 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:38.389415 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:38.389471 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:38.389473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.390104 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.390105 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:38.390637 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:38.390639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.390949 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.390951 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:38.391002 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:38.391448 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:38.391454 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:38.393121 (+ 1667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
W20260808 05:08:38.393311 26842 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:38.388934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:36837 (local address 127.12.251.62:45905)
0808 05:08:38.388996 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:38.388998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:38.389062 (+ 64us) server_negotiation.cc:407] Connection header received
0808 05:08:38.389143 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:38.389144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:38.389157 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:38.389197 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:38.389541 (+ 344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.390033 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.390710 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:38.390891 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:38.390952 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:38.393254 (+ 2302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:36837: BlockingRecv error: recv got EOF from 127.12.251.3:36837 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 05:08:39 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:39 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:39.127758 26845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:39.120753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:34219)
0808 05:08:39.120887 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:39.120898 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:39.120958 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:39.121104 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:39.121105 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:39.121316 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:39.121372 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:39.121374 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.122015 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.122015 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:39.122533 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:39.122534 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.122831 (+ 297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.122831 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:39.122870 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:39.125809 (+ 2939us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:39.125814 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:39.127696 (+ 1882us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":73,"threads_started":1}
W20260808 05:08:39.127866 26847 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:39.120826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:34219 (local address 127.12.251.62:45905)
0808 05:08:39.120939 (+ 113us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:39.120941 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:39.120959 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:08:39.121022 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:39.121023 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:39.121034 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:39.121089 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:39.121444 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.121957 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.122590 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.122778 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.122825 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:39.127786 (+ 4961us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:34219: BlockingRecv error: recv got EOF from 127.12.251.1:34219 (error 108)
Metrics: {"server-negotiator.queue_time_us":91,"thread_start_us":59,"threads_started":1}
Aug 08 05:08:39 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:39 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:39.277118 26848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:39.272637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:34055)
0808 05:08:39.272819 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:39.272831 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:39.272898 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:39.273066 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:39.273067 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:39.273271 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:39.273321 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:39.273323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.273956 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.273957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:39.274504 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:39.274506 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.274867 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.274868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:39.274925 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:39.275383 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:39.275388 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:39.277057 (+ 1669us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":94,"threads_started":1}
W20260808 05:08:39.277240 26847 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:39.272754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:34055 (local address 127.12.251.62:45905)
0808 05:08:39.272821 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:39.272823 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:39.272888 (+ 65us) server_negotiation.cc:407] Connection header received
0808 05:08:39.272988 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:39.272988 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:39.273000 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:39.273053 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:39.273396 (+ 343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.273885 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.274582 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.274794 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.274849 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:39.277151 (+ 2302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:34055: BlockingRecv error: recv got EOF from 127.12.251.2:34055 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 05:08:39 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:39 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:39.398097 26850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:39.393709 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:49715)
0808 05:08:39.393865 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:39.393876 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:39.393943 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:39.394077 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:39.394078 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:39.394249 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:39.394294 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:39.394296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.394943 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.394944 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:39.395473 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:39.395475 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.395797 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.395798 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:39.395852 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:39.396266 (+ 414us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:39.396271 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:39.398020 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":86,"threads_started":1}
W20260808 05:08:39.398175 26847 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:39.393793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:49715 (local address 127.12.251.62:45905)
0808 05:08:39.393855 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:39.393858 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:39.393931 (+ 73us) server_negotiation.cc:407] Connection header received
0808 05:08:39.394001 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:39.394002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:39.394016 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:39.394062 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:39.394360 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.394868 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.395546 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:39.395739 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:39.395793 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:39.398119 (+ 2326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:49715: BlockingRecv error: recv got EOF from 127.12.251.3:49715 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 05:08:40 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:40 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:40.132489 26852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:40.128208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:40909)
0808 05:08:40.128342 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:40.128352 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:40.128402 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:40.128544 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:40.128545 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:40.128712 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:40.128767 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:40.128769 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.129395 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.129396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:40.129950 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:40.129952 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.130265 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.130266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:40.130301 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:40.130739 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:40.130744 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:40.132426 (+ 1682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":63,"threads_started":1}
W20260808 05:08:40.132591 26853 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:40.128267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:40909 (local address 127.12.251.62:45905)
0808 05:08:40.128389 (+ 122us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:40.128391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:40.128400 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:40.128468 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:40.128468 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:40.128480 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:40.128530 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:40.128818 (+ 288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.129344 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.130020 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.130216 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.130264 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:40.132521 (+ 2257us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:40909: BlockingRecv error: recv got EOF from 127.12.251.1:40909 (error 108)
Metrics: {"server-negotiator.queue_time_us":98,"thread_start_us":58,"threads_started":1}
Aug 08 05:08:40 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:40 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:40.281677 26854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:40.277560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:54003)
0808 05:08:40.277687 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:40.277698 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:40.277756 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:40.277880 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:40.277880 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:40.278044 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:40.278096 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:40.278098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.278703 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.278705 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:40.279260 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:40.279262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.279556 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.279556 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:40.279594 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:40.279988 (+ 394us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:40.279992 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:40.281617 (+ 1625us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
W20260808 05:08:40.281770 26853 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:40.277615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:54003 (local address 127.12.251.62:45905)
0808 05:08:40.277661 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:40.277664 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:40.277745 (+ 81us) server_negotiation.cc:407] Connection header received
0808 05:08:40.277814 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:40.277815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:40.277827 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:40.277864 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:40.278147 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.278630 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.279327 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.279506 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.279553 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:40.281711 (+ 2158us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:54003: BlockingRecv error: recv got EOF from 127.12.251.2:54003 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 08 05:08:40 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:40 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:40.402997 26856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:40.398584 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:36883)
0808 05:08:40.398704 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:40.398714 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:40.398771 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:40.398884 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:40.398885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:40.399047 (+ 162us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:40.399102 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:40.399104 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.399777 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.399778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:40.400314 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:40.400316 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.400636 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.400637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:40.400677 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:40.401081 (+ 404us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:40.401086 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:40.402934 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":65,"threads_started":1}
W20260808 05:08:40.403102 26853 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:40.398631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:36883 (local address 127.12.251.62:45905)
0808 05:08:40.398678 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:40.398679 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:40.398757 (+ 78us) server_negotiation.cc:407] Connection header received
0808 05:08:40.398811 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:40.398812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:40.398825 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:40.398873 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:40.399180 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.399677 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.400385 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:40.400578 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:40.400630 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:40.403039 (+ 2409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:36883: BlockingRecv error: recv got EOF from 127.12.251.3:36883 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
Aug 08 05:08:41 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:41 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:41.137398 26857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:41.132953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:42513)
0808 05:08:41.133100 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:41.133111 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:41.133164 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:41.133332 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:41.133333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:41.133498 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:41.133551 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:41.133553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.134159 (+ 606us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.134160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:41.134673 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:41.134675 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.134991 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.134992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:41.135041 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:41.135498 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:41.135502 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:41.137302 (+ 1800us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":73,"threads_started":1}
W20260808 05:08:41.137488 26859 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:41.133024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:42513 (local address 127.12.251.62:45905)
0808 05:08:41.133166 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:41.133168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:41.133181 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:08:41.133248 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:41.133249 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:41.133263 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:41.133316 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:41.133605 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.134104 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.134744 (+ 640us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.134920 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.134964 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:41.137400 (+ 2436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:42513: BlockingRecv error: recv got EOF from 127.12.251.1:42513 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":68,"threads_started":1}
Aug 08 05:08:41 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:41 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:41.286571 26860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:41.282143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:44031)
0808 05:08:41.282302 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:41.282314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:41.282375 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:41.282491 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:41.282492 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:41.282661 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:41.282712 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:41.282714 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.283303 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.283304 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:41.283837 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:41.283838 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.284114 (+ 276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.284115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:41.284155 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:41.284589 (+ 434us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:41.284594 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:41.286500 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":85,"threads_started":1}
W20260808 05:08:41.286646 26859 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:41.282226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44031 (local address 127.12.251.62:45905)
0808 05:08:41.282297 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:41.282299 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:41.282375 (+ 76us) server_negotiation.cc:407] Connection header received
0808 05:08:41.282417 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:41.282418 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:41.282430 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:41.282488 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:41.282765 (+ 277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.283249 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.283892 (+ 643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.284064 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.284111 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:41.286590 (+ 2479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:44031: BlockingRecv error: recv got EOF from 127.12.251.2:44031 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 05:08:41 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:41 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:41.407796 26861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:41.403406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:37419)
0808 05:08:41.403581 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:41.403593 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:41.403660 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:41.403774 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:41.403774 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:41.403935 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:41.403986 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:41.403987 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.404572 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.404573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:41.405105 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:41.405107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.405427 (+ 320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.405428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:41.405486 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:41.405919 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:41.405923 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:41.407726 (+ 1803us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":112,"threads_started":1}
W20260808 05:08:41.407874 26859 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:41.403463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:37419 (local address 127.12.251.62:45905)
0808 05:08:41.403522 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:41.403524 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:41.403653 (+ 129us) server_negotiation.cc:407] Connection header received
0808 05:08:41.403702 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:41.403703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:41.403717 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:41.403762 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:41.404034 (+ 272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.404520 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.405156 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:41.405369 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:41.405413 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:41.407810 (+ 2397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:37419: BlockingRecv error: recv got EOF from 127.12.251.3:37419 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
Aug 08 05:08:42 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:42 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:42.142199 26863 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:42.137799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:59017)
0808 05:08:42.137944 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:42.137956 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:42.138012 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:42.138126 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:42.138127 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:42.138285 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:42.138337 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:42.138339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.138963 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.138964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:42.139491 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:42.139493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.139871 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.139872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:42.139930 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:42.140370 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:42.140374 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:42.142128 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":82,"threads_started":1}
W20260808 05:08:42.142287 26865 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:42.137904 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:59017 (local address 127.12.251.62:45905)
0808 05:08:42.138020 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:42.138022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:42.138029 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:42.138051 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:42.138051 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:42.138061 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:42.138116 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:42.138389 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.138906 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.139603 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.139805 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.139856 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:42.142219 (+ 2363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:59017: BlockingRecv error: recv got EOF from 127.12.251.1:59017 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":58,"threads_started":1}
Aug 08 05:08:42 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:42 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:42.291623 26866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:42.287024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:53151)
0808 05:08:42.287159 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:42.287170 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:42.287227 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:42.287384 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:42.287385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:42.287568 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:42.287618 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:42.287620 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.288401 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.288401 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:42.288924 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:42.288926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.289357 (+ 431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.289358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:42.289404 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:42.289811 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:42.289815 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:42.291562 (+ 1747us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":69,"threads_started":1}
W20260808 05:08:42.291720 26865 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:42.287073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:53151 (local address 127.12.251.62:45905)
0808 05:08:42.287136 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:42.287138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:42.287272 (+ 134us) server_negotiation.cc:407] Connection header received
0808 05:08:42.287304 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:42.287305 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:42.287325 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:42.287371 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:42.287673 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.288302 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.289015 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.289251 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.289353 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:42.291654 (+ 2301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:53151: BlockingRecv error: recv got EOF from 127.12.251.2:53151 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Aug 08 05:08:42 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:42 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:42.412542 26867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:42.408162 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:54531)
0808 05:08:42.408292 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:42.408302 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:42.408361 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:42.408486 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:42.408487 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:42.408653 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:42.408703 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:42.408705 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.409448 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.409448 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:42.409957 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:42.409959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.410266 (+ 307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.410267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:42.410301 (+ 34us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:42.410698 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:42.410703 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:42.412483 (+ 1780us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":81,"threads_started":1}
W20260808 05:08:42.412652 26865 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:42.408218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:54531 (local address 127.12.251.62:45905)
0808 05:08:42.408271 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:42.408273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:42.408359 (+ 86us) server_negotiation.cc:407] Connection header received
0808 05:08:42.408403 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:42.408404 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:42.408418 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:42.408475 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:42.408814 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.409380 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.410026 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:42.410212 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:42.410265 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:42.412578 (+ 2313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:54531: BlockingRecv error: recv got EOF from 127.12.251.3:54531 (error 108)
Metrics: {"server-negotiator.queue_time_us":31}
Aug 08 05:08:43 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:43 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:43.147176 26868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:43.142638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:36057)
0808 05:08:43.142765 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:43.142775 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:43.142823 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:43.142983 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:43.142985 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:43.143154 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:43.143207 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:43.143208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.143843 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.143844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:43.144379 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:43.144381 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.144706 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.144706 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:43.144744 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:43.145268 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:43.145274 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:43.147116 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
W20260808 05:08:43.147286 26870 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:43.142693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:36057 (local address 127.12.251.62:45905)
0808 05:08:43.142832 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:43.142834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:43.142842 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:43.142864 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:43.142865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:43.142876 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:43.142939 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:43.143273 (+ 334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.143771 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.144452 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.144658 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.144703 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:43.147210 (+ 2507us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:36057: BlockingRecv error: recv got EOF from 127.12.251.1:36057 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
Aug 08 05:08:43 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:43 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:43.296571 26871 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:43.292107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:50337)
0808 05:08:43.292254 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:43.292264 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:43.292321 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:43.292443 (+ 122us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:43.292443 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:43.292631 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:43.292682 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:43.292685 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.293318 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.293319 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:43.293887 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:43.293890 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.294209 (+ 319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.294209 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:43.294246 (+ 37us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:43.294691 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:43.294696 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:43.296500 (+ 1804us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
W20260808 05:08:43.296654 26870 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:43.292190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:50337 (local address 127.12.251.62:45905)
0808 05:08:43.292259 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:43.292261 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:43.292308 (+ 47us) server_negotiation.cc:407] Connection header received
0808 05:08:43.292367 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:43.292367 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:43.292378 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:43.292431 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:43.292734 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.293251 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.293962 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.294155 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.294206 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:43.296590 (+ 2384us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:50337: BlockingRecv error: recv got EOF from 127.12.251.2:50337 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 08 05:08:43 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:43 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:43.417451 26873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:43.412989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:54019)
0808 05:08:43.413120 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:43.413133 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:43.413202 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:43.413349 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:43.413350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:43.413542 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:43.413592 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:43.413594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.414247 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.414249 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:43.414801 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:43.414803 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.415149 (+ 346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.415151 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:43.415209 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:43.415656 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:43.415661 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:43.417365 (+ 1704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":68,"threads_started":1}
W20260808 05:08:43.417544 26870 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:43.413064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:54019 (local address 127.12.251.62:45905)
0808 05:08:43.413125 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:43.413128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:43.413191 (+ 63us) server_negotiation.cc:407] Connection header received
0808 05:08:43.413278 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:43.413279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:43.413295 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:43.413343 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:43.413666 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.414172 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.414882 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:43.415086 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:43.415143 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:43.417484 (+ 2341us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:54019: BlockingRecv error: recv got EOF from 127.12.251.3:54019 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
Aug 08 05:08:44 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:44 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:44.156471 26877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:44.147685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:47401)
0808 05:08:44.147808 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:44.147820 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:44.147878 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:44.148047 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:44.148049 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:44.148227 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:44.148279 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:44.148281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.148959 (+ 678us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.148960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:44.149601 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:44.149606 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.150029 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.150030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:44.150095 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:44.154666 (+ 4571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:44.154673 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:44.156399 (+ 1726us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":65,"threads_started":1}
W20260808 05:08:44.156595 26878 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:44.147772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:47401 (local address 127.12.251.62:45905)
0808 05:08:44.147926 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:44.147929 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:44.147937 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:44.147962 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:44.147962 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:44.147973 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:44.148031 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:44.148360 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.148881 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.149698 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.149939 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.150013 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:44.156504 (+ 6491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:47401: BlockingRecv error: recv got EOF from 127.12.251.1:47401 (error 108)
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":79,"threads_started":1}
Aug 08 05:08:44 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:44 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:44.301743 26879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:44.296998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:50371)
0808 05:08:44.297126 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:44.297139 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:44.297201 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:44.297384 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:44.297384 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:44.297560 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:44.297612 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:44.297614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.298236 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.298237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:44.298822 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:44.298825 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.299249 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.299250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:44.299314 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:44.299760 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:44.299766 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:44.301660 (+ 1894us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":57,"threads_started":1}
W20260808 05:08:44.301808 26878 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:44.297088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:50371 (local address 127.12.251.62:45905)
0808 05:08:44.297171 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:44.297173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:44.297186 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:08:44.297302 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:44.297303 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:44.297315 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:44.297364 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:44.297666 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.298175 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.298904 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.299174 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.299238 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:44.301756 (+ 2518us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:50371: BlockingRecv error: recv got EOF from 127.12.251.2:50371 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 08 05:08:44 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:44 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:44.422276 26880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:44.417913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:57397)
0808 05:08:44.418042 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:44.418054 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:44.418117 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:44.418253 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:44.418254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:44.418429 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:44.418499 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:44.418501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.419135 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.419136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:44.419676 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:44.419678 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.420007 (+ 329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.420008 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:44.420071 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:44.420451 (+ 380us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:44.420456 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:44.422184 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
W20260808 05:08:44.422336 26878 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:44.418027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:57397 (local address 127.12.251.62:45905)
0808 05:08:44.418095 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:44.418097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:44.418107 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:44.418179 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:44.418180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:44.418194 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:44.418239 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:44.418575 (+ 336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.419061 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.419756 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:44.419943 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:44.420002 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:44.422282 (+ 2280us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:57397: BlockingRecv error: recv got EOF from 127.12.251.3:57397 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Aug 08 05:08:45 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:45 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:45.161577 26881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:45.156910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:49267)
0808 05:08:45.157105 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:45.157117 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:45.157180 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:45.157317 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:45.157318 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:45.157499 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:45.157550 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:45.157552 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.158171 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.158172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:45.158734 (+ 562us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:45.158735 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.159063 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.159064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:45.159122 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:45.159570 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:45.159574 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:45.161487 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":112,"threads_started":1}
W20260808 05:08:45.161659 26882 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:45.156983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:49267 (local address 127.12.251.62:45905)
0808 05:08:45.157114 (+ 131us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:45.157116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:45.157162 (+ 46us) server_negotiation.cc:407] Connection header received
0808 05:08:45.157247 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:45.157247 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:45.157258 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:45.157305 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:45.157604 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.158103 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.158791 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.158978 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.159023 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:45.161595 (+ 2572us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:49267: BlockingRecv error: recv got EOF from 127.12.251.1:49267 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":69,"threads_started":1}
Aug 08 05:08:45 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:45 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:45.306550 26883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:45.302187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:48731)
0808 05:08:45.302333 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:45.302344 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:45.302402 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:45.302522 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:45.302523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:45.302695 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:45.302746 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:45.302748 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.303334 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.303335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:45.303930 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:45.303933 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.304261 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.304261 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:45.304306 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:45.304704 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:45.304708 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:45.306457 (+ 1749us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
W20260808 05:08:45.306608 26882 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:45.302268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:48731 (local address 127.12.251.62:45905)
0808 05:08:45.302330 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:45.302332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:45.302387 (+ 55us) server_negotiation.cc:407] Connection header received
0808 05:08:45.302445 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:45.302446 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:45.302456 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:45.302510 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:45.302793 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.303275 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.304015 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.304202 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.304255 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:45.306556 (+ 2301us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:48731: BlockingRecv error: recv got EOF from 127.12.251.2:48731 (error 108)
Metrics: {"server-negotiator.queue_time_us":32}
Aug 08 05:08:45 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:45 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:45.427062 26884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:45.422707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:36553)
0808 05:08:45.422851 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:45.422862 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:45.422932 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:45.423048 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:45.423049 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:45.423227 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:45.423274 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:45.423275 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.423862 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.423863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:45.424384 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:45.424386 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.424648 (+ 262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.424648 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:45.424684 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:45.425082 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:45.425086 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:45.426987 (+ 1901us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":73,"threads_started":1}
W20260808 05:08:45.427129 26882 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:45.422777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:36553 (local address 127.12.251.62:45905)
0808 05:08:45.422854 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:45.422855 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:45.422925 (+ 70us) server_negotiation.cc:407] Connection header received
0808 05:08:45.422976 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:45.422976 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:45.422989 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:45.423034 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:45.423325 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.423812 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.424436 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:45.424604 (+ 168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:45.424645 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:45.427074 (+ 2429us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:36553: BlockingRecv error: recv got EOF from 127.12.251.3:36553 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Aug 08 05:08:46 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:46 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:46.166666 26885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:46.162071 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:37047)
0808 05:08:46.162203 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:46.162214 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:46.162272 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:46.162434 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:46.162436 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:46.162615 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:46.162665 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:46.162667 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.163304 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.163305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:46.163868 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:46.163869 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.164239 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.164240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:46.164290 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:46.164773 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:46.164777 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:46.166605 (+ 1828us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
W20260808 05:08:46.166779 26886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:46.162146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:37047 (local address 127.12.251.62:45905)
0808 05:08:46.162261 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:46.162262 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:46.162271 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:46.162317 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:46.162317 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:46.162327 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:46.162385 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:46.162730 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.163242 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.163948 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.164167 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.164221 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:46.166705 (+ 2484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:37047: BlockingRecv error: recv got EOF from 127.12.251.1:37047 (error 108)
Metrics: {"server-negotiator.queue_time_us":93,"thread_start_us":55,"threads_started":1}
Aug 08 05:08:46 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:46 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:46.311580 26889 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:46.307037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:39283)
0808 05:08:46.307151 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:46.307162 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:46.307229 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:46.307380 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:46.307381 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:46.307574 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:46.307624 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:46.307627 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.308323 (+ 696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.308324 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:46.308862 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:46.308863 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.309243 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.309244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:46.309304 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:46.309751 (+ 447us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:46.309756 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:46.311510 (+ 1754us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":63,"threads_started":1}
W20260808 05:08:46.311640 26886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:46.307085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:39283 (local address 127.12.251.62:45905)
0808 05:08:46.307149 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:46.307151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:46.307220 (+ 69us) server_negotiation.cc:407] Connection header received
0808 05:08:46.307283 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:46.307284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:46.307305 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:46.307360 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:46.307716 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.308247 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.308947 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.309150 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.309208 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:46.311578 (+ 2370us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:39283: BlockingRecv error: recv got EOF from 127.12.251.2:39283 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 05:08:46 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:46 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:46.431947 26890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:46.427535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:41749)
0808 05:08:46.427684 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:46.427695 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:46.427756 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:46.427866 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:46.427867 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:46.428040 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:46.428088 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:46.428089 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.428676 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.428677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:46.429335 (+ 658us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:46.429339 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.429648 (+ 309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.429649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:46.429685 (+ 36us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:46.430076 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:46.430080 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:46.431857 (+ 1777us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":82,"threads_started":1}
W20260808 05:08:46.432024 26886 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:46.427615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:41749 (local address 127.12.251.62:45905)
0808 05:08:46.427678 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:46.427680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:46.427740 (+ 60us) server_negotiation.cc:407] Connection header received
0808 05:08:46.427796 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:46.427797 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:46.427810 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:46.427854 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:46.428137 (+ 283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.428624 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.429404 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:46.429594 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:46.429645 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:46.431970 (+ 2325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:41749: BlockingRecv error: recv got EOF from 127.12.251.3:41749 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 08 05:08:47 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:47 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:47.171551 26892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:47.167109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:45111)
0808 05:08:47.167236 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:47.167247 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:47.167296 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:47.167422 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:47.167423 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:47.167599 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:47.167648 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:47.167650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.168414 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.168415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:47.168989 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:47.168991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.169319 (+ 328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.169320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:47.169363 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:47.169764 (+ 401us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:47.169768 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:47.171481 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":58,"threads_started":1}
W20260808 05:08:47.171655 26894 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:47.167160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:45111 (local address 127.12.251.62:45905)
0808 05:08:47.167284 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:47.167286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:47.167293 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:47.167339 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:47.167340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:47.167351 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:47.167410 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:47.167700 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.168326 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.169055 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.169270 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.169321 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:47.171577 (+ 2256us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:45111: BlockingRecv error: recv got EOF from 127.12.251.1:45111 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":66,"threads_started":1}
Aug 08 05:08:47 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:47 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:47.316201 26895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:47.312015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:51821)
0808 05:08:47.312155 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:47.312166 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:47.312231 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:47.312346 (+ 115us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:47.312347 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:47.312536 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:47.312586 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:47.312588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.313180 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.313180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:47.313728 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:47.313729 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.314051 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.314051 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:47.314095 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:47.314508 (+ 413us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:47.314513 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:47.316140 (+ 1627us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":60,"threads_started":1}
W20260808 05:08:47.316296 26894 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:47.312126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:51821 (local address 127.12.251.62:45905)
0808 05:08:47.312179 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:47.312181 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:47.312215 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:08:47.312276 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:47.312276 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:47.312287 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:47.312332 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:47.312637 (+ 305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.313126 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.313794 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.313991 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.314044 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:47.316228 (+ 2184us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:51821: BlockingRecv error: recv got EOF from 127.12.251.2:51821 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Aug 08 05:08:47 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:47 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:47.437121 26898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:47.432404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:59679)
0808 05:08:47.432559 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:47.432573 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:47.432654 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:47.432797 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:47.432798 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:47.432990 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:47.433035 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:47.433038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.433766 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.433768 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:47.434427 (+ 659us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:47.434430 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.434792 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.434793 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:47.434851 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:47.435279 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:47.435284 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:47.437042 (+ 1758us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":64,"threads_started":1}
W20260808 05:08:47.437198 26894 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:47.432501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:59679 (local address 127.12.251.62:45905)
0808 05:08:47.432563 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:47.432565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:47.432635 (+ 70us) server_negotiation.cc:407] Connection header received
0808 05:08:47.432707 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:47.432708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:47.432724 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:47.432782 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:47.433108 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.433671 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.434494 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:47.434682 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:47.434761 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:47.437144 (+ 2383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:59679: BlockingRecv error: recv got EOF from 127.12.251.3:59679 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 08 05:08:48 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:48 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:48.176422 26899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:48.172023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:59369)
0808 05:08:48.172175 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:48.172187 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:48.172241 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:48.172353 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:48.172354 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:48.172536 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:48.172588 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:48.172589 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.173242 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.173243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:48.173848 (+ 605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:48.173851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.174145 (+ 294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.174146 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:48.174184 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:48.174624 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:48.174628 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:48.176343 (+ 1715us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":72,"threads_started":1}
W20260808 05:08:48.176611 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:48.172117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:59369 (local address 127.12.251.62:45905)
0808 05:08:48.172240 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:48.172242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:48.172250 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:48.172275 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:48.172275 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:48.172286 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:48.172342 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:48.172641 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.173143 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.173909 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.174097 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.174141 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:48.176545 (+ 2404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:59369: BlockingRecv error: recv got EOF from 127.12.251.1:59369 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":64,"threads_started":1}
Aug 08 05:08:48 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:48 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:48.322585 26902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:48.316645 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:35251)
0808 05:08:48.316805 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:48.316816 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:48.316877 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:48.317076 (+ 199us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:48.317078 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:48.317322 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:48.317388 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:48.317391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.318320 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.318322 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:48.319124 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:48.319128 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.319605 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.319607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:48.319669 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:48.320163 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:48.320170 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:48.322493 (+ 2323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":71,"threads_started":1}
W20260808 05:08:48.323197 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:48.316703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:35251 (local address 127.12.251.62:45905)
0808 05:08:48.316746 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:48.316748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:48.316879 (+ 131us) server_negotiation.cc:407] Connection header received
0808 05:08:48.316992 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:48.316993 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:48.317007 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:48.317057 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:48.317473 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.318231 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.319206 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.319524 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.319588 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:48.323145 (+ 3557us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:35251: BlockingRecv error: recv got EOF from 127.12.251.2:35251 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
Aug 08 05:08:48 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:48 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.3@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:48.441774 26903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:48.437551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.3:59577)
0808 05:08:48.437670 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:48.437680 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:48.437736 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:48.437848 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:48.437849 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:48.438027 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:48.438076 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:48.438077 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.438680 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.438681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:48.439224 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:48.439225 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.439535 (+ 310us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.439535 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:48.439574 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:48.439981 (+ 407us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:48.439986 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:48.441714 (+ 1728us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":57,"threads_started":1}
W20260808 05:08:48.441872 26900 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:48.437610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:59577 (local address 127.12.251.62:45905)
0808 05:08:48.437662 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:48.437663 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:48.437728 (+ 65us) server_negotiation.cc:407] Connection header received
0808 05:08:48.437777 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:48.437778 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:48.437791 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:48.437838 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:48.438127 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.438622 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.439281 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:48.439473 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:48.439525 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:48.441806 (+ 2281us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.3:59577: BlockingRecv error: recv got EOF from 127.12.251.3:59577 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
Aug 08 05:08:49 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:49 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.1@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:49.183917 26904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.176939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.1:50153)
0808 05:08:49.177095 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:49.177110 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:49.177169 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:49.177316 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:49.177317 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:49.177488 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:49.177540 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.177541 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.178166 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.178166 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.178709 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.178711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.179036 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.179037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.179072 (+ 35us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.182126 (+ 3054us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:49.182131 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:49.183855 (+ 1724us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":71,"threads_started":1}
W20260808 05:08:49.184075 26905 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:49.177012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:50153 (local address 127.12.251.62:45905)
0808 05:08:49.177151 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:49.177153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:49.177162 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:49.177238 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:49.177239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:49.177248 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:49.177302 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:49.177594 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.178108 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.178788 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.178981 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.179032 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.183989 (+ 4957us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.1:50153: BlockingRecv error: recv got EOF from 127.12.251.1:50153 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":74,"threads_started":1}
Aug 08 05:08:49 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
Aug 08 05:08:49 dist-test-slave-bndk krb5kdc[25301](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.251.2@KRBTEST.COM for oryx/127.12.251.62@KRBTEST.COM, Server not found in Kerberos database
I20260808 05:08:49.327809 26906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.323355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45905 (local address 127.12.251.2:40113)
0808 05:08:49.323503 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:49.323515 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:49.323581 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:49.323718 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:49.323719 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:49.323900 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:49.323947 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.323949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.324605 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.324607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.325146 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.325148 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.325510 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.325511 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.325571 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.326002 (+ 431us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:49.326008 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:49.327721 (+ 1713us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.251.62:45905: Server oryx/127.12.251.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":70,"threads_started":1}
W20260808 05:08:49.327883 26905 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:49.323431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:40113 (local address 127.12.251.62:45905)
0808 05:08:49.323494 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:49.323496 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:49.323562 (+ 66us) server_negotiation.cc:407] Connection header received
0808 05:08:49.323634 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:49.323635 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:49.323648 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:49.323695 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:49.324035 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.324531 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.325245 (+ 714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.325442 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.325499 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.327831 (+ 2332us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.251.2:40113: BlockingRecv error: recv got EOF from 127.12.251.2:40113 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:08:49.371567 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 26179
I20260808 05:08:49.384189 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 26420
I20260808 05:08:49.394258 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 26627
I20260808 05:08:49.404490 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 26074
2026-08-08T05:08:49Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17603 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-08T05:08:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:49Z Disabled control of system clock
I20260808 05:08:49.433377 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36203
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:39219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:36203
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260808 05:08:49.513592 26910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:49.513787 26910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:49.513805 26910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:49.514915 26910 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:49.514947 26910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:49.514958 26910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:49.514969 26910 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:49.514984 26910 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:49.516238 26910 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:39219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:36203
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36203
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:49.516428 26910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:49.516671 26910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:49.521499 26916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:49.521540 26910 server_base.cc:1034] running on GCE node
W20260808 05:08:49.521598 26917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:49.521517 26922 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:49.521999 26910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:49.522255 26910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:49.523389 26910 hybrid_clock.cc:648] HybridClock initialized: now 1786165729523375 us; error 30 us; skew 500 ppm
I20260808 05:08:49.524524 26910 webserver.cc:460] Webserver started at http://127.12.251.62:44481/ using document root <none> and password file <none>
I20260808 05:08:49.524739 26910 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:49.524785 26910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:49.524909 26910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:49.525956 26910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "cd4221301868480fbc082de6db39bebd"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "b4e5d9e6a2246053090403799c798cb2"
server_key_iv: "4f3ea2a22e4d4bd70b72461cc9f6fa1d"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.526283 26910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "cd4221301868480fbc082de6db39bebd"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "b4e5d9e6a2246053090403799c798cb2"
server_key_iv: "4f3ea2a22e4d4bd70b72461cc9f6fa1d"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.527426 26910 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:49.528087 26934 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.528229 26910 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:49.528311 26910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "cd4221301868480fbc082de6db39bebd"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "b4e5d9e6a2246053090403799c798cb2"
server_key_iv: "4f3ea2a22e4d4bd70b72461cc9f6fa1d"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.528366 26910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:49.540859 26910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:49.541116 26910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:49.541301 26910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:49.544991 26910 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:36203
I20260808 05:08:49.545027 27018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:36203 every 8 connection(s)
I20260808 05:08:49.545339 26910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:49.546010 27019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:49.547515 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 26910
I20260808 05:08:49.547585 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:49.547741 13292 external_mini_cluster.cc:1428] Setting key 9ecff3cc880e4a79232e2953b653a698
I20260808 05:08:49.548691 27019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd: Bootstrap starting.
I20260808 05:08:49.549369 27019 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:49.549643 27019 log.cc:824] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:49.550299 27019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd: No bootstrap required, opened a new log
I20260808 05:08:49.552474 27019 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4221301868480fbc082de6db39bebd" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36203 } }
I20260808 05:08:49.552618 27019 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:49.552654 27019 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd4221301868480fbc082de6db39bebd, State: Initialized, Role: FOLLOWER
I20260808 05:08:49.552803 27019 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4221301868480fbc082de6db39bebd" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36203 } }
I20260808 05:08:49.552888 27019 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:49.552910 27019 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:49.552955 27019 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:49.553092 27025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.548225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34026 (local address 127.12.251.62:36203)
0808 05:08:49.548386 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:49.548392 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:49.548417 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:08:49.548803 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:49.548812 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:49.548877 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:49.548989 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:49.549237 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.550125 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.551189 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.551617 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.551707 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.552332 (+ 625us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:49.552336 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:49.552336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:49.552501 (+ 165us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:49.552533 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:49.552543 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:49.552587 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:49.552775 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 05:08:49.552861 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":59,"threads_started":1}
I20260808 05:08:49.553573 27019 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4221301868480fbc082de6db39bebd" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36203 } }
I20260808 05:08:49.553679 27019 leader_election.cc:302] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd4221301868480fbc082de6db39bebd; no voters:
I20260808 05:08:49.553823 27019 leader_election.cc:288] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:49.553853 27032 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:49.554001 27032 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [term 1 LEADER]: Becoming Leader. State: Replica: cd4221301868480fbc082de6db39bebd, State: Running, Role: LEADER
I20260808 05:08:49.554088 27032 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4221301868480fbc082de6db39bebd" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36203 } }
I20260808 05:08:49.554138 27019 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:49.554481 27033 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd4221301868480fbc082de6db39bebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4221301868480fbc082de6db39bebd" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36203 } } }
I20260808 05:08:49.554502 27034 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd4221301868480fbc082de6db39bebd. Latest consensus state: current_term: 1 leader_uuid: "cd4221301868480fbc082de6db39bebd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd4221301868480fbc082de6db39bebd" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36203 } } }
I20260808 05:08:49.554661 27033 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:49.554672 27034 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:49.555064 27043 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:49.555490 27043 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:49.556936 27043 catalog_manager.cc:1347] Generated new cluster ID: f8abd306b280455388f9902ed57b57f5
I20260808 05:08:49.556988 27043 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:49.568287 27043 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:49.568807 27043 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:49.572781 27043 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd4221301868480fbc082de6db39bebd: Generated new TSK 0
I20260808 05:08:49.572943 27043 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:08:49.580292 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36203
--builtin_ntp_servers=127.12.251.20:39219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260808 05:08:49.679250 27059 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:49.679446 27059 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:49.679476 27059 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:49.680596 27059 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:49.680635 27059 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:49.680670 27059 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:49.682000 27059 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:39219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27059
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:49.682224 27059 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:49.682502 27059 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:49.687305 27072 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:49.687279 27070 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:49.687288 27068 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:49.687844 27059 server_base.cc:1034] running on GCE node
I20260808 05:08:49.688094 27059 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:49.688370 27059 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:49.689528 27059 hybrid_clock.cc:648] HybridClock initialized: now 1786165729689506 us; error 36 us; skew 500 ppm
I20260808 05:08:49.690974 27059 webserver.cc:460] Webserver started at http://127.12.251.1:34037/ using document root <none> and password file <none>
I20260808 05:08:49.691278 27059 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:49.691354 27059 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:49.691500 27059 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:49.692797 27059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "0a77d46c384549ad9cece2d8c9d67a68"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "2773bc6fd2107580308b5f543fd613aa"
server_key_iv: "d742017dab7f9f510711e884fb0ccc29"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.693190 27059 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "0a77d46c384549ad9cece2d8c9d67a68"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "2773bc6fd2107580308b5f543fd613aa"
server_key_iv: "d742017dab7f9f510711e884fb0ccc29"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.695194 27059 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:49.696687 27080 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.696867 27059 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:08:49.696954 27059 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "0a77d46c384549ad9cece2d8c9d67a68"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "2773bc6fd2107580308b5f543fd613aa"
server_key_iv: "d742017dab7f9f510711e884fb0ccc29"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.697016 27059 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:49.707923 27059 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:49.708165 27059 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:49.708261 27059 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:49.708436 27059 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:49.708712 27059 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:49.708741 27059 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.708768 27059 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:49.708784 27059 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.714202 27059 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:43525
I20260808 05:08:49.714265 27253 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:43525 every 8 connection(s)
I20260808 05:08:49.714556 27059 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:49.716315 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 27059
I20260808 05:08:49.716413 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:49.716604 13292 external_mini_cluster.cc:1428] Setting key 0d599645f83a5faa1aa1757e15fc3980
I20260808 05:08:49.717525 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36203
--builtin_ntp_servers=127.12.251.20:39219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 05:08:49.720139 27025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.715198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:41273 (local address 127.12.251.62:36203)
0808 05:08:49.715260 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:49.715262 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:49.715490 (+ 228us) server_negotiation.cc:407] Connection header received
0808 05:08:49.715996 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:49.715998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:49.716010 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:49.716058 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:49.716892 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.717534 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.718832 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.719032 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.719102 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.719879 (+ 777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:49.719881 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:49.719881 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:49.719885 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:49.719902 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:49.719906 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:49.719951 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:49.720031 (+ 80us) server_negotiation.cc:299] Negotiation successful
0808 05:08:49.720058 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:08:49.720340 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.715182 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36203 (local address 127.12.251.1:41273)
0808 05:08:49.715378 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:49.715410 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:49.715889 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:49.716136 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:49.716141 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:49.716151 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:49.716800 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.716806 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.717635 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.717636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.718744 (+ 1108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.718747 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.719130 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.719131 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.719258 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.719746 (+ 488us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:49.719746 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:49.719775 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:49.719799 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:49.719958 (+ 159us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:49.719964 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:49.719967 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:49.720029 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:08:49.720135 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":93,"threads_started":1}
I20260808 05:08:49.720834 27255 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36203
I20260808 05:08:49.720934 27255 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:49.721120 27255 heartbeater.cc:511] Master 127.12.251.62:36203 requested a full tablet report, sending...
I20260808 05:08:49.721647 26959 ts_manager.cc:194] Registered new tserver with Master: 0a77d46c384549ad9cece2d8c9d67a68 (127.12.251.1:43525)
I20260808 05:08:49.722271 26959 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.1:41273
W20260808 05:08:49.799233 27259 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:49.799425 27259 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:49.799448 27259 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:49.800621 27259 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:49.800663 27259 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:49.800686 27259 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:49.802034 27259 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:39219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27259
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:49.802261 27259 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:49.802534 27259 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:08:49.807403 27259 server_base.cc:1034] running on GCE node
W20260808 05:08:49.807344 27272 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:49.807363 27270 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:49.807353 27265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:49.807791 27259 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:49.808019 27259 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:49.809183 27259 hybrid_clock.cc:648] HybridClock initialized: now 1786165729809167 us; error 27 us; skew 500 ppm
I20260808 05:08:49.810338 27259 webserver.cc:460] Webserver started at http://127.12.251.2:39023/ using document root <none> and password file <none>
I20260808 05:08:49.810547 27259 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:49.810595 27259 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:49.810720 27259 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:49.811744 27259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "bc5ed62386b94e2aac71790169523378"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "6a6a59c369df761b9c08ab36391882a9"
server_key_iv: "5b92c7fcdeab1818a4a1349104516054"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.812139 27259 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "bc5ed62386b94e2aac71790169523378"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "6a6a59c369df761b9c08ab36391882a9"
server_key_iv: "5b92c7fcdeab1818a4a1349104516054"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.813371 27259 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:08:49.814043 27282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.814193 27259 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.814275 27259 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "bc5ed62386b94e2aac71790169523378"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "6a6a59c369df761b9c08ab36391882a9"
server_key_iv: "5b92c7fcdeab1818a4a1349104516054"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.814340 27259 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:49.832505 27259 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:49.832785 27259 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:49.832912 27259 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:49.833134 27259 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:49.833496 27259 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:49.833532 27259 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.833560 27259 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:49.833581 27259 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.839160 27259 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:34583
I20260808 05:08:49.839215 27453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:34583 every 8 connection(s)
I20260808 05:08:49.839519 27259 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:49.843603 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 27259
I20260808 05:08:49.843684 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:49.843856 13292 external_mini_cluster.cc:1428] Setting key 404073e943f55c31b622811c1332a883
I20260808 05:08:49.844532 27025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.840185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:41429 (local address 127.12.251.62:36203)
0808 05:08:49.840252 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:49.840254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:49.840485 (+ 231us) server_negotiation.cc:407] Connection header received
0808 05:08:49.840996 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:49.840998 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:49.841009 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:49.841061 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:49.841766 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.842258 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.843204 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.843387 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.843443 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.844283 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:49.844285 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:49.844285 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:49.844290 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:49.844305 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:49.844309 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:49.844350 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:49.844422 (+ 72us) server_negotiation.cc:299] Negotiation successful
0808 05:08:49.844450 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:08:49.844734 27457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.840155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36203 (local address 127.12.251.2:41429)
0808 05:08:49.840358 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:49.840390 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:49.840893 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:49.841135 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:49.841138 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:49.841146 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:49.841678 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.841684 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.842340 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.842341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.843122 (+ 781us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.843125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.843480 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.843481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.843601 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.844149 (+ 548us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:49.844150 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:49.844184 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:49.844208 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:49.844357 (+ 149us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:49.844362 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:49.844365 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:49.844427 (+ 62us) client_negotiation.cc:240] Negotiation successful
0808 05:08:49.844541 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":90,"threads_started":1}
I20260808 05:08:49.844862 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36203
--builtin_ntp_servers=127.12.251.20:39219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260808 05:08:49.845541 27455 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36203
I20260808 05:08:49.845643 27455 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:49.845829 27455 heartbeater.cc:511] Master 127.12.251.62:36203 requested a full tablet report, sending...
I20260808 05:08:49.846235 26959 ts_manager.cc:194] Registered new tserver with Master: bc5ed62386b94e2aac71790169523378 (127.12.251.2:34583)
I20260808 05:08:49.846692 26959 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.2:41429
W20260808 05:08:49.927377 27458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:49.927587 27458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:49.927608 27458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:49.928716 27458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:49.928756 27458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:49.928781 27458 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:49.930153 27458 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:39219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36203
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:49.930374 27458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:49.930645 27458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:49.935461 27468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:49.935467 27467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:49.935473 27471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:49.935729 27458 server_base.cc:1034] running on GCE node
I20260808 05:08:49.935943 27458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:49.936170 27458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:49.937268 27458 hybrid_clock.cc:648] HybridClock initialized: now 1786165729937249 us; error 29 us; skew 500 ppm
I20260808 05:08:49.938493 27458 webserver.cc:460] Webserver started at http://127.12.251.3:43213/ using document root <none> and password file <none>
I20260808 05:08:49.938727 27458 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:49.938777 27458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:49.938908 27458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:49.939942 27458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "24dfc45e46784103aef6284865b2935c"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "b43e0497ceba5f0dc710ae56559b4eee"
server_key_iv: "715b409b5f9f920324f02fae7de2067c"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.940291 27458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "24dfc45e46784103aef6284865b2935c"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "b43e0497ceba5f0dc710ae56559b4eee"
server_key_iv: "715b409b5f9f920324f02fae7de2067c"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.941532 27458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:08:49.942169 27480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.942322 27458 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:49.942397 27458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "24dfc45e46784103aef6284865b2935c"
format_stamp: "Formatted at 2026-08-08 05:08:49 on dist-test-slave-bndk"
server_key: "b43e0497ceba5f0dc710ae56559b4eee"
server_key_iv: "715b409b5f9f920324f02fae7de2067c"
server_key_version: "encryptionkey@0"
I20260808 05:08:49.942461 27458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:49.955011 27458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:49.955274 27458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:49.955400 27458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:49.955601 27458 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:49.955901 27458 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:49.955935 27458 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.955962 27458 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:49.955994 27458 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:49.961460 27458 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:43441
I20260808 05:08:49.961527 27648 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:43441 every 8 connection(s)
I20260808 05:08:49.961818 27458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:49.967460 27025 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.962477 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:48043 (local address 127.12.251.62:36203)
0808 05:08:49.962537 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:49.962540 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:49.962781 (+ 241us) server_negotiation.cc:407] Connection header received
0808 05:08:49.963245 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:49.963246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:49.963255 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:49.963312 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:49.963993 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.964622 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.966042 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.966342 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.966419 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.967264 (+ 845us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:49.967266 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:49.967266 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:49.967271 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:49.967285 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:49.967288 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:49.967331 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:49.967377 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:08:49.967400 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:08:49.967669 27654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:49.962461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36203 (local address 127.12.251.3:48043)
0808 05:08:49.962659 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:49.962698 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:49.963170 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:49.963366 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:49.963370 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:49.963378 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:49.963898 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.963905 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.964708 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.964710 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.965949 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:49.965953 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:49.966423 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:49.966424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:49.966577 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:49.967140 (+ 563us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:49.967140 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:49.967169 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:49.967191 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:49.967331 (+ 140us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:49.967333 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:49.967335 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:08:49.967379 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:08:49.967463 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":79,"threads_started":1}
I20260808 05:08:49.968062 27651 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36203
I20260808 05:08:49.968145 27651 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:49.968292 27651 heartbeater.cc:511] Master 127.12.251.62:36203 requested a full tablet report, sending...
I20260808 05:08:49.968611 26959 ts_manager.cc:194] Registered new tserver with Master: 24dfc45e46784103aef6284865b2935c (127.12.251.3:43441)
I20260808 05:08:49.968962 26959 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.3:48043
I20260808 05:08:49.970467 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 27458
I20260808 05:08:49.970535 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:49.970671 13292 external_mini_cluster.cc:1428] Setting key 9e142ebde4907527ed3a847c7fb164c4
I20260808 05:08:49.971395 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:08:49.973048 27025 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:49.972573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34040 (local address 127.12.251.62:36203)
0808 05:08:49.972621 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:49.972623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:49.972733 (+ 110us) server_negotiation.cc:407] Connection header received
0808 05:08:49.972794 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:49.972795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:49.972804 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:49.972849 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:49.972983 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34040: BlockingRecv error: recv got EOF from 127.0.0.1:34040 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:08:49.973117 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 27059
I20260808 05:08:49.993996 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 27259
I20260808 05:08:50.003988 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 27458
I20260808 05:08:50.020236 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 26910
2026-08-08T05:08:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (616 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-08T05:08:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:50Z Disabled control of system clock
I20260808 05:08:50.049515 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:43305
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:43305
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:08:50.131274 27671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:50.131497 27671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:50.131516 27671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:50.132640 27671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:50.132681 27671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:50.132694 27671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:50.132704 27671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:50.132725 27671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:50.134114 27671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:43305
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:43305
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:50.134351 27671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:50.134617 27671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:50.139249 27677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:50.139262 27679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:50.139262 27676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:50.139461 27671 server_base.cc:1034] running on GCE node
I20260808 05:08:50.139813 27671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:50.140080 27671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:50.141237 27671 hybrid_clock.cc:648] HybridClock initialized: now 1786165730141195 us; error 33 us; skew 500 ppm
I20260808 05:08:50.142419 27671 webserver.cc:460] Webserver started at http://127.12.251.62:45327/ using document root <none> and password file <none>
I20260808 05:08:50.142630 27671 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:50.142675 27671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:50.142803 27671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:50.143885 27671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "a674b2516a5b4564bc4f038f9e550525"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "95b50c85c888c8e353f38ea01a16a7be"
server_key_iv: "d8dcc96762827391e8ad163c009cd36c"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.144229 27671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "a674b2516a5b4564bc4f038f9e550525"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "95b50c85c888c8e353f38ea01a16a7be"
server_key_iv: "d8dcc96762827391e8ad163c009cd36c"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.145498 27671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:50.146148 27692 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.146286 27671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:50.146363 27671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "a674b2516a5b4564bc4f038f9e550525"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "95b50c85c888c8e353f38ea01a16a7be"
server_key_iv: "d8dcc96762827391e8ad163c009cd36c"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.146427 27671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:50.149662 27671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:50.149907 27671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:50.150031 27671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:50.153858 27671 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:43305
I20260808 05:08:50.153887 27764 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:43305 every 8 connection(s)
I20260808 05:08:50.154189 27671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:50.154789 27765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:50.157439 27765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525: Bootstrap starting.
I20260808 05:08:50.157981 27765 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:50.158260 27765 log.cc:824] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:50.158867 27765 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525: No bootstrap required, opened a new log
I20260808 05:08:50.160398 27765 raft_consensus.cc:348] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a674b2516a5b4564bc4f038f9e550525" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43305 } }
I20260808 05:08:50.160532 27765 raft_consensus.cc:374] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:50.160565 27765 raft_consensus.cc:729] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a674b2516a5b4564bc4f038f9e550525, State: Initialized, Role: FOLLOWER
I20260808 05:08:50.160704 27765 consensus_queue.cc:260] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a674b2516a5b4564bc4f038f9e550525" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43305 } }
I20260808 05:08:50.160763 27765 raft_consensus.cc:388] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:50.160784 27765 raft_consensus.cc:482] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:50.160826 27765 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:50.161442 27765 raft_consensus.cc:504] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a674b2516a5b4564bc4f038f9e550525" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43305 } }
I20260808 05:08:50.161531 27765 leader_election.cc:302] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a674b2516a5b4564bc4f038f9e550525; no voters:
I20260808 05:08:50.161674 27765 leader_election.cc:288] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:50.161720 27768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:50.161870 27768 raft_consensus.cc:686] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [term 1 LEADER]: Becoming Leader. State: Replica: a674b2516a5b4564bc4f038f9e550525, State: Running, Role: LEADER
I20260808 05:08:50.161916 27765 sys_catalog.cc:564] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:50.161962 27768 consensus_queue.cc:237] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a674b2516a5b4564bc4f038f9e550525" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43305 } }
I20260808 05:08:50.162326 27769 sys_catalog.cc:455] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a674b2516a5b4564bc4f038f9e550525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a674b2516a5b4564bc4f038f9e550525" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43305 } } }
I20260808 05:08:50.162418 27769 sys_catalog.cc:458] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:50.162557 27770 sys_catalog.cc:455] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a674b2516a5b4564bc4f038f9e550525. Latest consensus state: current_term: 1 leader_uuid: "a674b2516a5b4564bc4f038f9e550525" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a674b2516a5b4564bc4f038f9e550525" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 43305 } } }
I20260808 05:08:50.162638 27770 sys_catalog.cc:458] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:50.162647 27783 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:50.163321 27783 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:50.163911 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 27671
I20260808 05:08:50.164002 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:50.164175 13292 external_mini_cluster.cc:1428] Setting key bf9f26afe2a2e2c979d9a48a303c8d94
I20260808 05:08:50.164868 27783 catalog_manager.cc:1347] Generated new cluster ID: b81d0ebfa96c4d46b684c74e7d1adbe1
I20260808 05:08:50.164924 27783 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:50.170820 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:50.164631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39890 (local address 127.12.251.62:43305)
0808 05:08:50.164871 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:50.164880 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:50.164915 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:08:50.169532 (+ 4617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:50.169540 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:50.169591 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:50.169761 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:50.170342 (+ 581us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:50.170346 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:50.170346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:50.170351 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:50.170393 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:50.170408 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:50.170492 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:50.170548 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 05:08:50.170609 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":74,"threads_started":1}
I20260808 05:08:50.177949 27783 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:50.178110 27783 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:50.179803 27783 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a674b2516a5b4564bc4f038f9e550525: Generated new TSK 0
I20260808 05:08:50.179982 27783 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:08:50.185148 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43305
--builtin_ntp_servers=127.12.251.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:08:50.266746 27802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:50.266955 27802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:50.266994 27802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:50.268136 27802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:50.268174 27802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:50.268209 27802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:50.269584 27802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27802
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:50.269817 27802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:50.270100 27802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:50.275614 27811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:50.275621 27813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:50.275900 27802 server_base.cc:1034] running on GCE node
W20260808 05:08:50.275621 27815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:50.276189 27802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:50.276466 27802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:50.277623 27802 hybrid_clock.cc:648] HybridClock initialized: now 1786165730277600 us; error 35 us; skew 500 ppm
I20260808 05:08:50.279100 27802 webserver.cc:460] Webserver started at http://127.12.251.1:42425/ using document root <none> and password file <none>
I20260808 05:08:50.279366 27802 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:50.279435 27802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:50.279584 27802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:50.280961 27802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "650d9054104543489f3c70166a76e32f"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "29b9063c20cf1696b9292d09530b7a2e"
server_key_iv: "1e410b3806e4238bf22386170b51ff56"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.281368 27802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "650d9054104543489f3c70166a76e32f"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "29b9063c20cf1696b9292d09530b7a2e"
server_key_iv: "1e410b3806e4238bf22386170b51ff56"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.282838 27802 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:50.283601 27827 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.283756 27802 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:50.283833 27802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "650d9054104543489f3c70166a76e32f"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "29b9063c20cf1696b9292d09530b7a2e"
server_key_iv: "1e410b3806e4238bf22386170b51ff56"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.283902 27802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:50.287089 27802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:50.287341 27802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:50.287458 27802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:50.287644 27802 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:50.287935 27802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:50.287974 27802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.288000 27802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:50.288023 27802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.293565 27802 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:40987
I20260808 05:08:50.293630 27997 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:40987 every 8 connection(s)
I20260808 05:08:50.293919 27802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:08:50.296582 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:50.294586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:53603 (local address 127.12.251.62:43305)
0808 05:08:50.294645 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:50.294648 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:50.294860 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:08:50.295294 (+ 434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:50.295295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:50.295303 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:50.295350 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:50.296390 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:50.296392 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:50.296392 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:50.296396 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:50.296413 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:50.296417 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:50.296463 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:50.296515 (+ 52us) server_negotiation.cc:299] Negotiation successful
0808 05:08:50.296528 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:08:50.296753 28002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:50.294578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43305 (local address 127.12.251.1:53603)
0808 05:08:50.294748 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:50.294781 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:50.295222 (+ 441us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:50.295410 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:50.295413 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:50.295422 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:50.296234 (+ 812us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:50.296234 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:50.296261 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:50.296290 (+ 29us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:50.296469 (+ 179us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:50.296471 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:50.296473 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:08:50.296521 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:08:50.296568 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":82,"threads_started":1}
I20260808 05:08:50.297205 27998 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43305
I20260808 05:08:50.297320 27998 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:50.297468 27998 heartbeater.cc:511] Master 127.12.251.62:43305 requested a full tablet report, sending...
I20260808 05:08:50.297953 27717 ts_manager.cc:194] Registered new tserver with Master: 650d9054104543489f3c70166a76e32f (127.12.251.1:40987)
I20260808 05:08:50.300743 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 27802
I20260808 05:08:50.300815 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:50.300954 13292 external_mini_cluster.cc:1428] Setting key 03932c160ae53cbc9303072379215004
I20260808 05:08:50.301837 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43305
--builtin_ntp_servers=127.12.251.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:08:50.382838 28004 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:50.383051 28004 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:50.383072 28004 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:50.384204 28004 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:50.384243 28004 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:50.384272 28004 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:50.385633 28004 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28004
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:50.385846 28004 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:50.386130 28004 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:50.391383 28010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:50.391371 28016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:50.391415 28011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:50.391428 28004 server_base.cc:1034] running on GCE node
I20260808 05:08:50.391728 28004 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:50.391922 28004 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:50.393069 28004 hybrid_clock.cc:648] HybridClock initialized: now 1786165730393055 us; error 27 us; skew 500 ppm
I20260808 05:08:50.394258 28004 webserver.cc:460] Webserver started at http://127.12.251.2:35481/ using document root <none> and password file <none>
I20260808 05:08:50.394469 28004 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:50.394519 28004 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:50.394644 28004 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:50.395671 28004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "bf6c7332f20a45578091d3678c7fa64e"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "96d1d8560472eaaf7d9660fdd0b1e9eb"
server_key_iv: "c3b15cad18251fa72b4c543b87dbec8e"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.396006 28004 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "bf6c7332f20a45578091d3678c7fa64e"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "96d1d8560472eaaf7d9660fdd0b1e9eb"
server_key_iv: "c3b15cad18251fa72b4c543b87dbec8e"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.397284 28004 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:50.397959 28026 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.398113 28004 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:50.398195 28004 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "bf6c7332f20a45578091d3678c7fa64e"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "96d1d8560472eaaf7d9660fdd0b1e9eb"
server_key_iv: "c3b15cad18251fa72b4c543b87dbec8e"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.398255 28004 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:50.401551 28004 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:50.401779 28004 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:50.401895 28004 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:50.402081 28004 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:50.402359 28004 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:50.402392 28004 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.402417 28004 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:50.402441 28004 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.407748 28004 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:34151
I20260808 05:08:50.407783 28202 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:34151 every 8 connection(s)
I20260808 05:08:50.408082 28004 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:08:50.410728 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:50.408752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:50965 (local address 127.12.251.62:43305)
0808 05:08:50.408797 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:50.408799 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:50.409005 (+ 206us) server_negotiation.cc:407] Connection header received
0808 05:08:50.409510 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:50.409511 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:50.409517 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:50.409554 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:50.410548 (+ 994us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:50.410549 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:50.410550 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:50.410553 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:50.410569 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:50.410574 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:50.410619 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:50.410662 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 05:08:50.410673 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:08:50.410898 28205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:50.408718 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43305 (local address 127.12.251.2:50965)
0808 05:08:50.408887 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:50.408925 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:50.409402 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:50.409615 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:50.409618 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:50.409626 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:50.410419 (+ 793us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:50.410420 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:50.410447 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:50.410475 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:50.410616 (+ 141us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:50.410618 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:50.410620 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:08:50.410668 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:08:50.410714 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":76,"threads_started":1}
I20260808 05:08:50.411350 28203 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43305
I20260808 05:08:50.411432 28203 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:50.411579 28203 heartbeater.cc:511] Master 127.12.251.62:43305 requested a full tablet report, sending...
I20260808 05:08:50.411916 27717 ts_manager.cc:194] Registered new tserver with Master: bf6c7332f20a45578091d3678c7fa64e (127.12.251.2:34151)
I20260808 05:08:50.416965 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 28004
I20260808 05:08:50.417048 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:50.417173 13292 external_mini_cluster.cc:1428] Setting key bcfbf27c2e58c08557bc4ad7fa9bc3c1
I20260808 05:08:50.418020 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43305
--builtin_ntp_servers=127.12.251.20:36997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260808 05:08:50.497848 28207 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:50.498040 28207 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:50.498061 28207 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:50.499152 28207 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:50.499184 28207 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:50.499207 28207 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:50.500468 28207 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:43305
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28207
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:50.500684 28207 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:50.500936 28207 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:50.505663 28216 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:50.505681 28215 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:50.505666 28219 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:50.505839 28207 server_base.cc:1034] running on GCE node
I20260808 05:08:50.506062 28207 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:50.506263 28207 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:50.507401 28207 hybrid_clock.cc:648] HybridClock initialized: now 1786165730507384 us; error 33 us; skew 500 ppm
I20260808 05:08:50.508553 28207 webserver.cc:460] Webserver started at http://127.12.251.3:45433/ using document root <none> and password file <none>
I20260808 05:08:50.508764 28207 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:50.508812 28207 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:50.508935 28207 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:50.509964 28207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "ba91c21bbb5642adb7a884bb2e566937"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "30ec56efb02ebb98d2ffd3c00afa343b"
server_key_iv: "87814e7b56caad733b0fb716c00365bf"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.510277 28207 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "ba91c21bbb5642adb7a884bb2e566937"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "30ec56efb02ebb98d2ffd3c00afa343b"
server_key_iv: "87814e7b56caad733b0fb716c00365bf"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.511490 28207 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:08:50.512099 28228 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.512252 28207 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:08:50.512331 28207 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "ba91c21bbb5642adb7a884bb2e566937"
format_stamp: "Formatted at 2026-08-08 05:08:50 on dist-test-slave-bndk"
server_key: "30ec56efb02ebb98d2ffd3c00afa343b"
server_key_iv: "87814e7b56caad733b0fb716c00365bf"
server_key_version: "encryptionkey@0"
I20260808 05:08:50.512390 28207 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:50.515556 28207 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:50.515789 28207 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:50.515901 28207 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:50.516074 28207 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:50.516345 28207 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:50.516377 28207 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.516403 28207 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:50.516427 28207 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:50.521754 28207 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:39717
I20260808 05:08:50.521808 28418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:39717 every 8 connection(s)
I20260808 05:08:50.522074 28207 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:50.522853 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 28207
I20260808 05:08:50.522928 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:50.523105 13292 external_mini_cluster.cc:1428] Setting key 1ac67cc59a0491b2f8d5f9ea20d01e11
I20260808 05:08:50.524750 27801 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:50.522685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:39553 (local address 127.12.251.62:43305)
0808 05:08:50.522727 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:50.522729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:50.522951 (+ 222us) server_negotiation.cc:407] Connection header received
0808 05:08:50.523405 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:50.523407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:50.523414 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:50.523459 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:50.524519 (+ 1060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:50.524521 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:50.524521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:08:50.524525 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:50.524540 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:08:50.524545 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:50.524594 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:50.524667 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 05:08:50.524683 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:08:50.524911 28422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:50.522661 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:43305 (local address 127.12.251.3:39553)
0808 05:08:50.522832 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:50.522865 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:50.523304 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:50.523526 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:50.523530 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:50.523539 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:50.524381 (+ 842us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:08:50.524381 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:50.524406 (+ 25us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:08:50.524431 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:50.524599 (+ 168us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:50.524605 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:50.524608 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:50.524673 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:08:50.524731 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":66,"threads_started":1}
I20260808 05:08:50.525275 28420 heartbeater.cc:347] Connected to a master server at 127.12.251.62:43305
I20260808 05:08:50.525367 28420 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:50.525503 28420 heartbeater.cc:511] Master 127.12.251.62:43305 requested a full tablet report, sending...
I20260808 05:08:50.525803 27717 ts_manager.cc:194] Registered new tserver with Master: ba91c21bbb5642adb7a884bb2e566937 (127.12.251.3:39717)
I20260808 05:08:50.534643 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260808 05:08:50.536355 27801 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:08:50.535871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39892 (local address 127.12.251.62:43305)
0808 05:08:50.535937 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:50.535940 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:50.536063 (+ 123us) server_negotiation.cc:407] Connection header received
0808 05:08:50.536147 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:50.536147 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:50.536152 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:50.536199 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:50.536296 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39892: BlockingRecv error: recv got EOF from 127.0.0.1:39892 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:08:50.536459 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 27802
I20260808 05:08:50.549889 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 28004
I20260808 05:08:50.563273 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 28207
I20260808 05:08:50.575914 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 27671
2026-08-08T05:08:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (559 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:50 dist-test-slave-bndk krb5kdc[28435](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:50 dist-test-slave-bndk krb5kdc[28435](info): set up 2 sockets
Aug 08 05:08:50 dist-test-slave-bndk krb5kdc[28435](info): commencing operation
krb5kdc: starting...
W20260808 05:08:51.707787 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:51 dist-test-slave-bndk krb5kdc[28435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:08:51.823294 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:32907
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:32907
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:51.903005 28458 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:51.903199 28458 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:51.903219 28458 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:51.904287 28458 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:08:51.904321 28458 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:51.904335 28458 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:51.904345 28458 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:08:51.904358 28458 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:08:51.905803 28458 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:32907
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:32907
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28458
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:51.905995 28458 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:51.906165 28458 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:51.910753 28474 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:51.910763 28473 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:51.910940 28458 server_base.cc:1034] running on GCE node
W20260808 05:08:51.911026 28476 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:51.911248 28458 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:51.911536 28458 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:51.912675 28458 hybrid_clock.cc:648] HybridClock initialized: now 1786165731912660 us; error 31 us; skew 500 ppm
Aug 08 05:08:51 dist-test-slave-bndk krb5kdc[28435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165731, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:51.915019 28458 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:08:51.915423 28458 webserver.cc:460] Webserver started at http://127.12.251.62:41775/ using document root <none> and password file <none>
I20260808 05:08:51.915647 28458 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:51.915695 28458 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:51.915822 28458 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:51.916798 28458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "9e4104e4946c404b93550e007c9fd617"
format_stamp: "Formatted at 2026-08-08 05:08:51 on dist-test-slave-bndk"
server_key: "9c6fdae4b5f5a016df53dac4988c9666"
server_key_iv: "e12356135ea29dae7db0fe1c00853852"
server_key_version: "encryptionkey@0"
I20260808 05:08:51.917122 28458 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "9e4104e4946c404b93550e007c9fd617"
format_stamp: "Formatted at 2026-08-08 05:08:51 on dist-test-slave-bndk"
server_key: "9c6fdae4b5f5a016df53dac4988c9666"
server_key_iv: "e12356135ea29dae7db0fe1c00853852"
server_key_version: "encryptionkey@0"
I20260808 05:08:51.918340 28458 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:08:51.918968 28485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:51.919124 28458 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:51.919196 28458 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "9e4104e4946c404b93550e007c9fd617"
format_stamp: "Formatted at 2026-08-08 05:08:51 on dist-test-slave-bndk"
server_key: "9c6fdae4b5f5a016df53dac4988c9666"
server_key_iv: "e12356135ea29dae7db0fe1c00853852"
server_key_version: "encryptionkey@0"
I20260808 05:08:51.919256 28458 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:51.937943 28458 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:51.939699 28458 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:51.939828 28458 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:51.943746 28458 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:32907
I20260808 05:08:51.943780 28565 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:32907 every 8 connection(s)
I20260808 05:08:51.944104 28458 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:08:51.945051 28566 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:51.947350 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 28458
I20260808 05:08:51.947376 28566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617: Bootstrap starting.
I20260808 05:08:51.947438 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:08:51.947623 13292 external_mini_cluster.cc:1428] Setting key b645f0ce9fdf8a3cf579f0eeb2a6bc4c
I20260808 05:08:51.947993 28566 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:51.948385 28566 log.cc:824] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:51.949123 28566 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617: No bootstrap required, opened a new log
I20260808 05:08:51.951241 28566 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4104e4946c404b93550e007c9fd617" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32907 } }
I20260808 05:08:51.951426 28566 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:51.951457 28566 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e4104e4946c404b93550e007c9fd617, State: Initialized, Role: FOLLOWER
I20260808 05:08:51.951577 28566 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4104e4946c404b93550e007c9fd617" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32907 } }
I20260808 05:08:51.951668 28566 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:08:51.951735 28566 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:08:51.951776 28566 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:51.952334 28566 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4104e4946c404b93550e007c9fd617" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32907 } }
I20260808 05:08:51.952451 28566 leader_election.cc:302] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e4104e4946c404b93550e007c9fd617; no voters:
I20260808 05:08:51.952615 28566 leader_election.cc:288] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:08:51.952654 28572 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:51.952872 28572 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [term 1 LEADER]: Becoming Leader. State: Replica: 9e4104e4946c404b93550e007c9fd617, State: Running, Role: LEADER
I20260808 05:08:51.952955 28566 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:08:51.952999 28572 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4104e4946c404b93550e007c9fd617" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32907 } }
I20260808 05:08:51.953397 28572 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e4104e4946c404b93550e007c9fd617. Latest consensus state: current_term: 1 leader_uuid: "9e4104e4946c404b93550e007c9fd617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4104e4946c404b93550e007c9fd617" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32907 } } }
I20260808 05:08:51.953449 28574 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e4104e4946c404b93550e007c9fd617" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e4104e4946c404b93550e007c9fd617" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 32907 } } }
I20260808 05:08:51.953636 28574 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [sys.catalog]: This master's current role is: LEADER
I20260808 05:08:51.954018 28572 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617 [sys.catalog]: This master's current role is: LEADER
Aug 08 05:08:51 dist-test-slave-bndk krb5kdc[28435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
W20260808 05:08:51.954891 28599 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:08:51.954936 28599 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:08:51.954993 28587 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:08:51.955214 28587 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:08:51.956779 28587 catalog_manager.cc:1347] Generated new cluster ID: 9ed5e907cdcd4c65857900821f375a94
I20260808 05:08:51.956830 28587 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:08:51.958823 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:51.948109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48148 (local address 127.12.251.62:32907)
0808 05:08:51.948277 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:51.948285 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:51.948310 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:08:51.948811 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:51.948821 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:51.948880 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:51.949002 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:51.949782 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:51.950634 (+ 852us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:51.951706 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:51.952163 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:51.952238 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:51.955255 (+ 3017us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:51.955259 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:51.955260 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:51.955272 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:51.957202 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:51.957657 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:51.957660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:51.957660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:51.957763 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:51.957961 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:51.957962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:51.957962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:51.958227 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:51.958380 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:51.958478 (+ 98us) server_negotiation.cc:299] Negotiation successful
0808 05:08:51.958602 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":64,"threads_started":1}
I20260808 05:08:51.966812 28587 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:08:51.967489 28587 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:08:51.977795 28587 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617: Generated new TSK 0
I20260808 05:08:51.977967 28587 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:08:52.008664 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:32907
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:52.089610 28610 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:52.089799 28610 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:52.089821 28610 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:52.090878 28610 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:52.090910 28610 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:52.090934 28610 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:08:52.092317 28610 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:32907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28610
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:52.092509 28610 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:52.092689 28610 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:52.097353 28617 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:52.097389 28622 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:52.097506 28619 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:52.097397 28610 server_base.cc:1034] running on GCE node
I20260808 05:08:52.097733 28610 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:52.097947 28610 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:52.099082 28610 hybrid_clock.cc:648] HybridClock initialized: now 1786165732099067 us; error 28 us; skew 500 ppm
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[28435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165732, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:52.101495 28610 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:08:52.101891 28610 webserver.cc:460] Webserver started at http://127.12.251.1:41285/ using document root <none> and password file <none>
I20260808 05:08:52.102106 28610 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:52.102154 28610 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:52.102283 28610 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:52.103271 28610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "1115f5f3b86346c0985675e2a3a78958"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "a28308674272b3ee22912a40b4df2b41"
server_key_iv: "edf6b2ccd018b288a06b83081f388b48"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.103601 28610 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "1115f5f3b86346c0985675e2a3a78958"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "a28308674272b3ee22912a40b4df2b41"
server_key_iv: "edf6b2ccd018b288a06b83081f388b48"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.104805 28610 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:08:52.105482 28633 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.105615 28610 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:52.105700 28610 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "1115f5f3b86346c0985675e2a3a78958"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "a28308674272b3ee22912a40b4df2b41"
server_key_iv: "edf6b2ccd018b288a06b83081f388b48"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.105760 28610 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:52.117882 28610 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:52.119536 28610 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:52.119676 28610 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:52.119876 28610 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:52.120168 28610 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:52.120203 28610 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.120229 28610 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:52.120247 28610 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.125798 28610 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:39305
I20260808 05:08:52.125859 28811 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:39305 every 8 connection(s)
I20260808 05:08:52.126137 28610 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[28435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165732, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:52.133617 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 28610
I20260808 05:08:52.133716 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:08:52.133894 13292 external_mini_cluster.cc:1428] Setting key 88a9224d685899c408bb006a9ef5016b
I20260808 05:08:52.134665 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.126784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:54399 (local address 127.12.251.62:32907)
0808 05:08:52.126840 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.126841 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.127034 (+ 193us) server_negotiation.cc:407] Connection header received
0808 05:08:52.127490 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.127491 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.127499 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.127555 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:52.128403 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.128891 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.129878 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.130088 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.130151 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.132042 (+ 1891us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:52.132043 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:52.132043 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:52.132050 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:52.133310 (+ 1260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.133644 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.133645 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.133646 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.133711 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.133988 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.133990 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.133990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.134128 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:52.134194 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.134477 (+ 283us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.134579 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:08:52.134812 28815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.126763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:32907 (local address 127.12.251.1:54399)
0808 05:08:52.126915 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.126956 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.127416 (+ 460us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.127608 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.127611 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.128137 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:52.128335 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.128340 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.128951 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.128951 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.129750 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.129752 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.130159 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.130160 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.130265 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.130664 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:52.130672 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:52.131962 (+ 1290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:52.133364 (+ 1402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:52.133367 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:52.133369 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:52.133575 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:52.133784 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:52.133785 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:52.133786 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:52.133893 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:52.134184 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:52.134190 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:52.134337 (+ 147us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.134439 (+ 102us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.134614 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
I20260808 05:08:52.135330 28812 heartbeater.cc:347] Connected to a master server at 127.12.251.62:32907
I20260808 05:08:52.135428 28812 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:52.135607 28812 heartbeater.cc:511] Master 127.12.251.62:32907 requested a full tablet report, sending...
I20260808 05:08:52.136098 28509 ts_manager.cc:194] Registered new tserver with Master: 1115f5f3b86346c0985675e2a3a78958 (127.12.251.1:39305)
I20260808 05:08:52.136667 28509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:54399
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:08:52.158252 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:32907
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:52.238474 28819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:52.238674 28819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:52.238704 28819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:52.239886 28819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:52.239929 28819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:52.239970 28819 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:08:52.241425 28819 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:32907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:52.241659 28819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:52.241859 28819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:52.246616 28829 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:52.246655 28832 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:52.246591 28828 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:52.246595 28819 server_base.cc:1034] running on GCE node
I20260808 05:08:52.246974 28819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:52.247211 28819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:52.248381 28819 hybrid_clock.cc:648] HybridClock initialized: now 1786165732248363 us; error 35 us; skew 500 ppm
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[28435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165732, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:52.250834 28819 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:08:52.251247 28819 webserver.cc:460] Webserver started at http://127.12.251.2:38553/ using document root <none> and password file <none>
I20260808 05:08:52.251453 28819 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:52.251494 28819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:52.251588 28819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:52.252540 28819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "616615278bdb43e39356e4cc4d86d123"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "0a3e2b4c6d6182b67c05e61a0b7c15e1"
server_key_iv: "241f732ff9244d505c1199326eacebfa"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.252843 28819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "616615278bdb43e39356e4cc4d86d123"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "0a3e2b4c6d6182b67c05e61a0b7c15e1"
server_key_iv: "241f732ff9244d505c1199326eacebfa"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.254134 28819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:08:52.254812 28843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.255005 28819 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:08:52.255091 28819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "616615278bdb43e39356e4cc4d86d123"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "0a3e2b4c6d6182b67c05e61a0b7c15e1"
server_key_iv: "241f732ff9244d505c1199326eacebfa"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.255159 28819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:52.265419 28819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:52.267012 28819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:52.267138 28819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:52.267321 28819 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:52.267588 28819 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:52.267620 28819 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.267647 28819 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:52.267673 28819 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.273079 28819 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:40897
I20260808 05:08:52.273134 29025 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:40897 every 8 connection(s)
I20260808 05:08:52.273433 28819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[28435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165732, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:52.281598 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.274089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:57997 (local address 127.12.251.62:32907)
0808 05:08:52.274164 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.274167 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.274315 (+ 148us) server_negotiation.cc:407] Connection header received
0808 05:08:52.274770 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.274771 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.274781 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.274846 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:52.275699 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.276195 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.277139 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.277406 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.277462 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.279346 (+ 1884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:52.279348 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:52.279348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:52.279356 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:52.280447 (+ 1091us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.280783 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.280784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.280784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.280845 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.281054 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.281055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.281056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.281174 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:52.281275 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.281468 (+ 193us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.281533 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:08:52.281741 29028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.274059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:32907 (local address 127.12.251.2:57997)
0808 05:08:52.274206 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.274241 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.274692 (+ 451us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.274899 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.274902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.275439 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:52.275626 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.275631 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.276261 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.276262 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.277056 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.277058 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.277469 (+ 411us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.277469 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.277580 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.277964 (+ 384us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:52.277972 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:52.279257 (+ 1285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:52.280511 (+ 1254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:52.280517 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:52.280518 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:52.280728 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:52.280890 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:52.280890 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:52.280891 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:52.280976 (+ 85us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:52.281261 (+ 285us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:52.281264 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:52.281367 (+ 103us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.281442 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.281567 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":80,"threads_started":1}
I20260808 05:08:52.282202 29026 heartbeater.cc:347] Connected to a master server at 127.12.251.62:32907
I20260808 05:08:52.282289 29026 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:52.282471 29026 heartbeater.cc:511] Master 127.12.251.62:32907 requested a full tablet report, sending...
I20260808 05:08:52.282577 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 28819
I20260808 05:08:52.282665 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:08:52.282855 13292 external_mini_cluster.cc:1428] Setting key 20140166474ba89c562fcc3021563fcb
I20260808 05:08:52.282867 28509 ts_manager.cc:194] Registered new tserver with Master: 616615278bdb43e39356e4cc4d86d123 (127.12.251.2:40897)
I20260808 05:08:52.283357 28509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:57997
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:08:52.306026 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:32907
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34585
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:08:52.386952 29031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:08:52.387162 29031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:08:52.387193 29031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:08:52.388302 29031 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:08:52.388351 29031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:08:52.388386 29031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:08:52.389854 29031 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34585
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:32907
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29031
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:08:52.390096 29031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:08:52.390307 29031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:08:52.395013 29042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:52.395088 29039 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:08:52.395020 29038 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:08:52.395273 29031 server_base.cc:1034] running on GCE node
I20260808 05:08:52.395502 29031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:08:52.395723 29031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:08:52.396881 29031 hybrid_clock.cc:648] HybridClock initialized: now 1786165732396865 us; error 31 us; skew 500 ppm
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[28435](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165732, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:08:52.399371 29031 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:08:52.399791 29031 webserver.cc:460] Webserver started at http://127.12.251.3:42771/ using document root <none> and password file <none>
I20260808 05:08:52.399999 29031 fs_manager.cc:359] Metadata directory not provided
I20260808 05:08:52.400043 29031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:08:52.400162 29031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:08:52.401193 29031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "3d7b010bb6db4fd29d14b6d2ece737bb"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "e0141f8be48de51b1a698cea0a17c979"
server_key_iv: "fabf46a71d6709cbad1b3389ab1c9be0"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.401582 29031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "3d7b010bb6db4fd29d14b6d2ece737bb"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "e0141f8be48de51b1a698cea0a17c979"
server_key_iv: "fabf46a71d6709cbad1b3389ab1c9be0"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.402837 29031 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:08:52.403460 29050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.403614 29031 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.403705 29031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "3d7b010bb6db4fd29d14b6d2ece737bb"
format_stamp: "Formatted at 2026-08-08 05:08:52 on dist-test-slave-bndk"
server_key: "e0141f8be48de51b1a698cea0a17c979"
server_key_iv: "fabf46a71d6709cbad1b3389ab1c9be0"
server_key_version: "encryptionkey@0"
I20260808 05:08:52.403775 29031 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:08:52.420084 29031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:08:52.422117 29031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:08:52.422242 29031 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:08:52.422435 29031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:08:52.422732 29031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:08:52.422765 29031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.422793 29031 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:08:52.422816 29031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:08:52.428217 29031 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:40297
I20260808 05:08:52.428277 29219 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:40297 every 8 connection(s)
I20260808 05:08:52.428558 29031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:08:52.430828 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 29031
I20260808 05:08:52.430935 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:08:52.431123 13292 external_mini_cluster.cc:1428] Setting key ca3e35a1cea7cf313043a6c0203de353
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[28435](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165732, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:08:52.436865 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.429233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:57077 (local address 127.12.251.62:32907)
0808 05:08:52.429318 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.429320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.429493 (+ 173us) server_negotiation.cc:407] Connection header received
0808 05:08:52.429984 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.429985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.429998 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.430051 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:52.430971 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.431630 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.432673 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.432858 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.432907 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.434827 (+ 1920us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:52.434828 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:52.434828 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:52.434834 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:52.435854 (+ 1020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.436194 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.436194 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.436195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.436238 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.436409 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.436410 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.436410 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.436510 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:52.436555 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.436750 (+ 195us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.436802 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260808 05:08:52.437058 29222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.429193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:32907 (local address 127.12.251.3:57077)
0808 05:08:52.429372 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.429407 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.429888 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.430118 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.430122 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.430691 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:08:52.430877 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.430882 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.431710 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.431711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.432601 (+ 890us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.432604 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.432916 (+ 312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.432916 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.433022 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.433489 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:08:52.433497 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:08:52.434749 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:08:52.435917 (+ 1168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:52.435922 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:52.435924 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:52.436139 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:52.436282 (+ 143us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:08:52.436283 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:08:52.436283 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:08:52.436370 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:08:52.436551 (+ 181us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:08:52.436554 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:08:52.436659 (+ 105us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.436733 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.436844 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":96,"threads_started":1}
I20260808 05:08:52.437507 29220 heartbeater.cc:347] Connected to a master server at 127.12.251.62:32907
I20260808 05:08:52.437593 29220 heartbeater.cc:464] Registering TS with master...
I20260808 05:08:52.437734 29220 heartbeater.cc:511] Master 127.12.251.62:32907 requested a full tablet report, sending...
I20260808 05:08:52.438036 28509 ts_manager.cc:194] Registered new tserver with Master: 3d7b010bb6db4fd29d14b6d2ece737bb (127.12.251.3:40297)
I20260808 05:08:52.438386 28509 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:57077
I20260808 05:08:52.442674 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:08:52.448899 28570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.443943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48154 (local address 127.12.251.62:32907)
0808 05:08:52.443991 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.443992 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.444085 (+ 93us) server_negotiation.cc:407] Connection header received
0808 05:08:52.444132 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.444132 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.444139 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.444182 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:08:52.444676 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.445108 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.445810 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.445985 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.446032 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.446983 (+ 951us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:08:52.446984 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:08:52.446984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:08:52.446989 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:08:52.448101 (+ 1112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.448350 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.448351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.448351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.448393 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:08:52.448515 (+ 122us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:08:52.448516 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:08:52.448516 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:08:52.448630 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:08:52.448698 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.448766 (+ 68us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.448819 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:08:52.450187 28509 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48154:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:08:52.451702 28509 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:08:52.457644 29229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.453775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39305 (local address 127.0.0.1:45034)
0808 05:08:52.453971 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.453980 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.454020 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.454574 (+ 554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.454575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.454578 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:52.454623 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.454625 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.455710 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.455711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.456461 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.456462 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.457290 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.457291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.457372 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.457386 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.457465 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.457530 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":2,"thread_start_us":47,"threads_started":1}
I20260808 05:08:52.457748 29230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.453559 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:40897 (local address 127.0.0.1:39340)
0808 05:08:52.453684 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.453719 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.453787 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.454317 (+ 530us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.454318 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.454320 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:52.454362 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.454363 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.455341 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.455342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.456664 (+ 1322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.456665 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.457488 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.457489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.457550 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.457555 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.457605 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.457646 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":33,"thread_start_us":80,"threads_started":1}
I20260808 05:08:52.457901 29233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.453730 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37666 (local address 127.12.251.3:40297)
0808 05:08:52.453908 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.453912 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.453926 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:08:52.454015 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.454017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.454033 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.454149 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:52.454297 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.455336 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.456741 (+ 1405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.457477 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.457541 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.457596 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.457793 (+ 197us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.457831 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":91,"threads_started":1}
I20260808 05:08:52.457963 29236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.453986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45034 (local address 127.12.251.1:39305)
0808 05:08:52.454346 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.454350 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.454360 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:08:52.454401 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.454403 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.454417 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.454495 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:52.454694 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.455629 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.456538 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.457194 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.457289 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.457349 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.457836 (+ 487us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.457880 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":93,"threads_started":1}
I20260808 05:08:52.458036 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.453576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:40297 (local address 127.0.0.1:37666)
0808 05:08:52.453877 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.453888 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.453940 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.454157 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.454159 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.454162 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:52.454225 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.454226 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.455429 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.455430 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.456659 (+ 1229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.456662 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.457627 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.457628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.457680 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.457683 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.457726 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.457756 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":268,"mutex_wait_us":38,"thread_start_us":54,"threads_started":1}
I20260808 05:08:52.458076 29231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.453676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39340 (local address 127.12.251.2:40897)
0808 05:08:52.454122 (+ 446us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.454127 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.454135 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:08:52.454173 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.454175 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.454221 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.454375 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:52.454446 (+ 71us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.455246 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.456758 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.457411 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.457473 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.457525 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.457649 (+ 124us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.457686 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":88,"threads_started":1}
I20260808 05:08:52.458590 28708 tablet_service.cc:1467] Processing CreateTablet for tablet 843dcc04046d42e38a6c6b8f89f67e96 (DEFAULT_TABLE table=test-table [id=868826c0f2534d0a9d6a64a1d28b9161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:52.458686 29125 tablet_service.cc:1467] Processing CreateTablet for tablet 843dcc04046d42e38a6c6b8f89f67e96 (DEFAULT_TABLE table=test-table [id=868826c0f2534d0a9d6a64a1d28b9161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:52.458693 28922 tablet_service.cc:1467] Processing CreateTablet for tablet 843dcc04046d42e38a6c6b8f89f67e96 (DEFAULT_TABLE table=test-table [id=868826c0f2534d0a9d6a64a1d28b9161]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:08:52.458941 28708 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 843dcc04046d42e38a6c6b8f89f67e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:52.458998 29125 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 843dcc04046d42e38a6c6b8f89f67e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:52.458998 28922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 843dcc04046d42e38a6c6b8f89f67e96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:08:52.461449 29237 tablet_bootstrap.cc:492] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958: Bootstrap starting.
I20260808 05:08:52.462190 29238 tablet_bootstrap.cc:492] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Bootstrap starting.
I20260808 05:08:52.462266 29237 tablet_bootstrap.cc:654] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:52.462471 29239 tablet_bootstrap.cc:492] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Bootstrap starting.
I20260808 05:08:52.462751 29237 log.cc:824] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:52.462903 29238 tablet_bootstrap.cc:654] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:52.463074 29239 tablet_bootstrap.cc:654] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Neither blocks nor log segments found. Creating new log.
I20260808 05:08:52.463470 29237 tablet_bootstrap.cc:492] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958: No bootstrap required, opened a new log
I20260808 05:08:52.463456 29238 log.cc:824] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:52.463536 29237 ts_tablet_manager.cc:1397] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:52.463603 29239 log.cc:824] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:08:52.464208 29239 tablet_bootstrap.cc:492] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: No bootstrap required, opened a new log
I20260808 05:08:52.464200 29238 tablet_bootstrap.cc:492] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: No bootstrap required, opened a new log
I20260808 05:08:52.464267 29239 ts_tablet_manager.cc:1397] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:52.464268 29238 ts_tablet_manager.cc:1397] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:08:52.465463 29237 raft_consensus.cc:348] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.465641 29237 raft_consensus.cc:374] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:52.465677 29237 raft_consensus.cc:729] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1115f5f3b86346c0985675e2a3a78958, State: Initialized, Role: FOLLOWER
I20260808 05:08:52.465734 29239 raft_consensus.cc:348] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.465835 29237 consensus_queue.cc:260] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.465881 29239 raft_consensus.cc:374] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:52.465917 29239 raft_consensus.cc:729] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d7b010bb6db4fd29d14b6d2ece737bb, State: Initialized, Role: FOLLOWER
I20260808 05:08:52.466028 29239 consensus_queue.cc:260] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.466126 29237 ts_tablet_manager.cc:1428] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:08:52.466255 28812 heartbeater.cc:503] Master 127.12.251.62:32907 was elected leader, sending a full tablet report...
I20260808 05:08:52.466180 29238 raft_consensus.cc:348] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.466289 29239 ts_tablet_manager.cc:1428] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:08:52.466313 29238 raft_consensus.cc:374] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:08:52.466346 29238 raft_consensus.cc:729] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 616615278bdb43e39356e4cc4d86d123, State: Initialized, Role: FOLLOWER
I20260808 05:08:52.466298 29220 heartbeater.cc:503] Master 127.12.251.62:32907 was elected leader, sending a full tablet report...
I20260808 05:08:52.466449 29238 consensus_queue.cc:260] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.466723 29238 ts_tablet_manager.cc:1428] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:08:52.466859 29026 heartbeater.cc:503] Master 127.12.251.62:32907 was elected leader, sending a full tablet report...
W20260808 05:08:52.523947 29027 tablet.cc:2369] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:08:52.539182 29253 raft_consensus.cc:482] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:08:52.539305 29253 raft_consensus.cc:504] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.539706 29253 leader_election.cc:288] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3d7b010bb6db4fd29d14b6d2ece737bb (127.12.251.3:40297), 1115f5f3b86346c0985675e2a3a78958 (127.12.251.1:39305)
I20260808 05:08:52.542469 29236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.539943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:51749 (local address 127.12.251.1:39305)
0808 05:08:52.539987 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.539990 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.540137 (+ 147us) server_negotiation.cc:407] Connection header received
0808 05:08:52.540181 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.540181 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.540189 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.540221 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:52.540363 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.540830 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.541802 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.542175 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.542237 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.542246 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.542366 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.542401 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:08:52.542470 29233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.539969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:59901 (local address 127.12.251.3:40297)
0808 05:08:52.540006 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.540008 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.540017 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:08:52.540074 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.540076 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.540087 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.540137 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:08:52.540397 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.540851 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.541802 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.542170 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.542234 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.542245 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.542366 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.542398 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:08:52.542481 29028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.539877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:40297 (local address 127.12.251.2:59901)
0808 05:08:52.539940 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.539952 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.540009 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.540265 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.540265 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.540267 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:52.540323 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.540324 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.540928 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.540929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.541714 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.541717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.542241 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.542242 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.542305 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.542309 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.542354 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.542401 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45,"mutex_wait_us":38}
I20260808 05:08:52.542493 29254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.539877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39305 (local address 127.12.251.2:51749)
0808 05:08:52.540063 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.540074 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:08:52.540131 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:08:52.540236 (+ 105us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:08:52.540236 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:08:52.540238 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:08:52.540295 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.540296 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.540905 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.540906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.541725 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:08:52.541728 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.542244 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.542244 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:08:52.542308 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.542311 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:08:52.542354 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:08:52.542392 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"mutex_wait_us":14,"thread_start_us":108,"threads_started":1}
I20260808 05:08:52.542860 29158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843dcc04046d42e38a6c6b8f89f67e96" candidate_uuid: "616615278bdb43e39356e4cc4d86d123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" is_pre_election: true
I20260808 05:08:52.543020 29158 raft_consensus.cc:2454] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616615278bdb43e39356e4cc4d86d123 in term 0.
I20260808 05:08:52.543167 28733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843dcc04046d42e38a6c6b8f89f67e96" candidate_uuid: "616615278bdb43e39356e4cc4d86d123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1115f5f3b86346c0985675e2a3a78958" is_pre_election: true
I20260808 05:08:52.543244 28848 leader_election.cc:302] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d7b010bb6db4fd29d14b6d2ece737bb, 616615278bdb43e39356e4cc4d86d123; no voters:
I20260808 05:08:52.543300 28733 raft_consensus.cc:2454] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 616615278bdb43e39356e4cc4d86d123 in term 0.
I20260808 05:08:52.543359 29253 raft_consensus.cc:2781] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:08:52.543406 29253 raft_consensus.cc:482] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:08:52.543422 29253 raft_consensus.cc:3037] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:52.544275 29253 raft_consensus.cc:504] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.544380 29253 leader_election.cc:288] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [CANDIDATE]: Term 1 election: Requested vote from peers 3d7b010bb6db4fd29d14b6d2ece737bb (127.12.251.3:40297), 1115f5f3b86346c0985675e2a3a78958 (127.12.251.1:39305)
I20260808 05:08:52.544524 29158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843dcc04046d42e38a6c6b8f89f67e96" candidate_uuid: "616615278bdb43e39356e4cc4d86d123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb"
I20260808 05:08:52.544549 28733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "843dcc04046d42e38a6c6b8f89f67e96" candidate_uuid: "616615278bdb43e39356e4cc4d86d123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1115f5f3b86346c0985675e2a3a78958"
I20260808 05:08:52.544595 29158 raft_consensus.cc:3037] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:52.544610 28733 raft_consensus.cc:3037] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:08:52.545327 29158 raft_consensus.cc:2454] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616615278bdb43e39356e4cc4d86d123 in term 1.
I20260808 05:08:52.545358 28733 raft_consensus.cc:2454] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 616615278bdb43e39356e4cc4d86d123 in term 1.
I20260808 05:08:52.545490 28848 leader_election.cc:302] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3d7b010bb6db4fd29d14b6d2ece737bb, 616615278bdb43e39356e4cc4d86d123; no voters:
I20260808 05:08:52.545594 29253 raft_consensus.cc:2781] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:08:52.545732 29253 raft_consensus.cc:686] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 1 LEADER]: Becoming Leader. State: Replica: 616615278bdb43e39356e4cc4d86d123, State: Running, Role: LEADER
I20260808 05:08:52.545818 29253 consensus_queue.cc:237] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } }
I20260808 05:08:52.546576 28509 catalog_manager.cc:5495] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 reported cstate change: term changed from 0 to 1, leader changed from <none> to 616615278bdb43e39356e4cc4d86d123 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "616615278bdb43e39356e4cc4d86d123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "616615278bdb43e39356e4cc4d86d123" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40897 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 } health_report { overall_health: UNKNOWN } } }
I20260808 05:08:52.571449 29231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.569184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39354 (local address 127.12.251.2:40897)
0808 05:08:52.569256 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0808 05:08:52.569258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:08:52.569265 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:08:52.569299 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:08:52.569300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:08:52.569318 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:08:52.569379 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:08:52.569522 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.569981 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.570716 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:08:52.570914 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:08:52.570974 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:08:52.571125 (+ 151us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:08:52.571228 (+ 103us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:08:52.571312 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:08:52.571341 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 05:08:52.571359 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260808 05:08:52.573056 29158 raft_consensus.cc:1261] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 1 FOLLOWER]: Refusing update from remote peer 616615278bdb43e39356e4cc4d86d123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:52.573069 28733 raft_consensus.cc:1261] T 843dcc04046d42e38a6c6b8f89f67e96 P 1115f5f3b86346c0985675e2a3a78958 [term 1 FOLLOWER]: Refusing update from remote peer 616615278bdb43e39356e4cc4d86d123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:08:52.573374 29253 consensus_queue.cc:1035] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1115f5f3b86346c0985675e2a3a78958" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:52.573515 29255 consensus_queue.cc:1035] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3d7b010bb6db4fd29d14b6d2ece737bb" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 40297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:08:52.576766 29260 mvcc.cc:205] Tried to move back new op lower bound from 7316134840616873984 to 7316134840508207104. Current Snapshot: MvccSnapshot[applied={T|T < 7316134840616873984}]
I20260808 05:08:52.577558 29261 mvcc.cc:205] Tried to move back new op lower bound from 7316134840616873984 to 7316134840508207104. Current Snapshot: MvccSnapshot[applied={T|T < 7316134840616873984 or (T in {7316134840616873984})}]
I20260808 05:08:52.578296 28509 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:52.578380 28509 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:48154:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:08:52.579066 28509 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e4104e4946c404b93550e007c9fd617: Sending DeleteTablet for 3 replicas of tablet 843dcc04046d42e38a6c6b8f89f67e96
I20260808 05:08:52.579401 28708 tablet_service.cc:1514] Processing DeleteTablet for tablet 843dcc04046d42e38a6c6b8f89f67e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:52 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:45034
I20260808 05:08:52.579404 29125 tablet_service.cc:1514] Processing DeleteTablet for tablet 843dcc04046d42e38a6c6b8f89f67e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:52 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:37666
I20260808 05:08:52.579687 28922 tablet_service.cc:1514] Processing DeleteTablet for tablet 843dcc04046d42e38a6c6b8f89f67e96 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:08:52 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:39340
I20260808 05:08:52.579842 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 28610
I20260808 05:08:52.589169 29269 tablet_replica.cc:330] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: stopping tablet replica
I20260808 05:08:52.589344 29269 raft_consensus.cc:2229] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:08:52.589491 29269 raft_consensus.cc:2258] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:52.590528 29276 tablet_replica.cc:330] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: stopping tablet replica
I20260808 05:08:52.590649 29276 raft_consensus.cc:2229] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:08:52.590764 29276 raft_consensus.cc:2258] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:08:52.591033 29269 ts_tablet_manager.cc:1905] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:52.591223 29276 ts_tablet_manager.cc:1905] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:08:52.592839 29269 ts_tablet_manager.cc:1918] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:52.592932 29276 ts_tablet_manager.cc:1918] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:08:52.592999 29276 log.cc:1196] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/843dcc04046d42e38a6c6b8f89f67e96
I20260808 05:08:52.593096 29269 log.cc:1196] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/843dcc04046d42e38a6c6b8f89f67e96
I20260808 05:08:52.593304 29276 ts_tablet_manager.cc:1939] T 843dcc04046d42e38a6c6b8f89f67e96 P 616615278bdb43e39356e4cc4d86d123: Deleting consensus metadata
I20260808 05:08:52.593534 29269 ts_tablet_manager.cc:1939] T 843dcc04046d42e38a6c6b8f89f67e96 P 3d7b010bb6db4fd29d14b6d2ece737bb: Deleting consensus metadata
I20260808 05:08:52.593763 28489 catalog_manager.cc:4841] TS 616615278bdb43e39356e4cc4d86d123 (127.12.251.2:40897): tablet 843dcc04046d42e38a6c6b8f89f67e96 (table test-table [id=868826c0f2534d0a9d6a64a1d28b9161]) successfully deleted
I20260808 05:08:52.594050 28490 catalog_manager.cc:4841] TS 3d7b010bb6db4fd29d14b6d2ece737bb (127.12.251.3:40297): tablet 843dcc04046d42e38a6c6b8f89f67e96 (table test-table [id=868826c0f2534d0a9d6a64a1d28b9161]) successfully deleted
W20260808 05:08:52.595685 28489 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:39305 (error 108)
I20260808 05:08:52.596158 29235 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:08:52.596041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39305 (local address 127.0.0.1:45050)
0808 05:08:52.596091 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0808 05:08:52.596128 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:39305: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 05:08:52.596261 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 28819
W20260808 05:08:52.601730 28489 catalog_manager.cc:4584] TS 1115f5f3b86346c0985675e2a3a78958 (127.12.251.1:39305): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 843dcc04046d42e38a6c6b8f89f67e96: Network error: Client connection negotiation failed: client connection to 127.12.251.1:39305: connect: Connection refused (error 111)
I20260808 05:08:52.607370 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 29031
I20260808 05:08:52.614324 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 28458
2026-08-08T05:08:52Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2033 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[29284](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[29284](info): set up 2 sockets
Aug 08 05:08:52 dist-test-slave-bndk krb5kdc[29284](info): commencing operation
krb5kdc: starting...
W20260808 05:08:53.736465 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:08:53 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:08:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:08:53Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/rangeradmin_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/rangeradmin_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/rangerlookup_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/rangerlookup_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
I20260808 05:08:53.891893 13292 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskTWVJbZ/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/postgres -l logfile start
2026-08-08 05:08:56.195 UTC [29333] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 05:08:56.195 UTC [29333] LOG: listening on IPv4 address "127.12.251.20", port 37481
2026-08-08 05:08:56.198 UTC [29333] LOG: listening on Unix socket "/tmp/.s.PGSQL.37481"
2026-08-08 05:08:56.221 UTC [29338] LOG: database system was shut down at 2026-08-08 05:08:54 UTC
2026-08-08 05:08:56.224 UTC [29333] LOG: database system is ready to accept connections
I20260808 05:08:57.263098 13292 mini_postgres.cc:96] Postgres bound to 37481
2026-08-08 05:08:57.271 UTC [29354] FATAL: database "slave" does not exist
127.12.251.20:37481 - accepting connections
I20260808 05:08:57.271857 13292 mini_ranger.cc:161] Starting Ranger...
I20260808 05:08:57.287122 13292 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 05:08:57.712248 13292 mini_ranger.cc:87] Created ranger Postgres database
I20260808 05:08:57.712339 13292 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-admin
2026-08-08 05:08:58,062 [I] DB FLAVOR :POSTGRES
2026-08-08 05:08:58,063 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:08:58,063 [I] Checking connection..
2026-08-08 05:08:58,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 05:08:58,308 [I] Checking connection passed.
2026-08-08 05:08:58,308 [I] --------- Verifying version history table ---------
2026-08-08 05:08:58,308 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:08:58,570 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:08:58,570 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:08:58,808 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:08:58,808 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 05:08:58,808 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 05:08:59.055 UTC [29449] WARNING: there is no transaction in progress
2026-08-08 05:08:59,061 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 05:08:59,062 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:08:59,328 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 05:08:59,329 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:08:59,329 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 05:08:59,583 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 05:08:59,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bndk.c.gcp-upstream.internal','N') ;"
2026-08-08 05:09:00,073 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:09:00,331 [I] Table x_portal_user does not exist in database ranger
2026-08-08 05:09:00,332 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:09:00,587 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 05:09:00,587 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:09:00,815 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:09:01,045 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 05:09:01,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 05:09:01.994 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.009 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.024 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.038 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.053 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.072 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.124 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.130 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.143 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.152 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.162 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.175 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.184 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.189 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.195 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02.201 UTC [29622] WARNING: there is no transaction in progress
2026-08-08 05:09:02,763 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 05:09:02,764 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 05:09:03,013 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 05:09:03,013 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:09:03,272 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 05:09:03,273 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:09:03,519 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 05:09:03,520 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:09:03,768 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:09:04,028 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bndk.c.gcp-upstream.internal';"
2026-08-08 05:09:04,276 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 05:09:04,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 05:09:04,528 [I] DB_PATCHES have already been applied
I20260808 05:09:04.533936 13292 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-admin:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskTWVJbZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 05:09:04.534011 13292 mini_ranger.cc:193] Using host: 127.12.251.20
I20260808 05:09:04.537781 13292 mini_ranger.cc:227] Ranger admin URL: http://127.12.251.20:33371
Aug 08, 2026 5:09:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:09:04 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:09:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:09:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:09:04 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:09:05 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:09:05 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 05:09:05.733736 13292 mini_ranger.cc:160] Time spent starting Ranger: real 8.462s user 0.008s sys 0.003s
Aug 08, 2026 5:09:25 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:09:25 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 08, 2026 5:09:25 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:09:25 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:09:26 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 05:09:27.125077 13292 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/rangerkms_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/rangerkms_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.251.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.251.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 05:09:27 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165767, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 05:09:27.210775 13292 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 05:09:27.220438 13292 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 05:09:28.061246 13292 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 05:09:28.061337 13292 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms
I20260808 05:09:28.061353 13292 mini_ranger_kms.cc:227] Using postgres at 127.12.251.20:37481
2026-08-08 05:09:28,627 [I] DB FLAVOR :POSTGRES
2026-08-08 05:09:28,627 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:09:28,627 [I] Checking connection
2026-08-08 05:09:28,627 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 05:09:28,863 [I] connection success
2026-08-08 05:09:28,863 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 05:09:28,864 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 05:09:28,864 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 05:09:29,091 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 05:09:29,091 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:09:29,091 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 05:09:29,092 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:37481/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 05:09:29,619 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 05:09:30.061633 13292 mini_ranger_kms.cc:310] Created kms service
I20260808 05:09:30.238605 13292 mini_ranger_kms.cc:326] Created kudu user
I20260808 05:09:30.282569 13292 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 05:09:30 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165767, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:09:30.665943 13292 mini_ranger_kms.cc:384] Added ranger policy
I20260808 05:09:30.666077 13292 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms:/tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 05:09:30.666100 13292 mini_ranger_kms.cc:240] Using host: 127.12.251.20
I20260808 05:09:30.671428 13292 mini_ranger_kms.cc:276] Ranger KMS PID: 29882
I20260808 05:09:30.671557 13292 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.251.20:54157
Aug 08, 2026 5:09:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:09:31 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:09:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:09:31 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:09:32 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:09:32 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 05:09:32 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165772, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.251.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:09:33.134812 13292 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.924s user 0.020s sys 0.218s
I20260808 05:09:33.134927 13292 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 05:09:33.135010 13292 mini_ranger_kms.cc:401] 127.12.251.20:54157/kms/v1/keys
Aug 08 05:09:33 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165772, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.251.20@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
Aug 08 05:09:33 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165772, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.251.20@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
Aug 08 05:09:35 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:09:35.992278 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45243
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:45243
--ranger_config_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:54157/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:09:36.078235 29960 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:09:36.078446 29960 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:09:36.078469 29960 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:09:36.079597 29960 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:09:36.079640 29960 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:09:36.079658 29960 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:09:36.079669 29960 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:09:36.079680 29960 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:09:36.081362 29960 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.251.20:54157/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:45243
--ranger_config_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45243
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29960
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:09:36.081588 29960 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:09:36.081837 29960 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:09:36.087020 29971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:09:36.087029 29967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:09:36.087097 29969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:09:36.087215 29960 server_base.cc:1034] running on GCE node
I20260808 05:09:36.087543 29960 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:09:36.087817 29960 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:09:36.088971 29960 hybrid_clock.cc:648] HybridClock initialized: now 1786165776088945 us; error 42 us; skew 500 ppm
Aug 08 05:09:36 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165776, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:09:36.095021 29960 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:09:36.095487 29960 webserver.cc:460] Webserver started at http://127.12.251.62:42019/ using document root <none> and password file <none>
I20260808 05:09:36.095691 29960 fs_manager.cc:359] Metadata directory not provided
I20260808 05:09:36.095731 29960 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:09:36.095856 29960 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:09:36 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165776, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:09:36.159060 29960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0"
format_stamp: "Formatted at 2026-08-08 05:09:36 on dist-test-slave-bndk"
server_key: "fbdd5bd1f281721dbb8d24925cde6bc6"
server_key_iv: "82a36f883c4911ebdaf50e4975157c38"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:36.159459 29960 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0"
format_stamp: "Formatted at 2026-08-08 05:09:36 on dist-test-slave-bndk"
server_key: "fbdd5bd1f281721dbb8d24925cde6bc6"
server_key_iv: "82a36f883c4911ebdaf50e4975157c38"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:36.160841 29960 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260808 05:09:36.175374 29979 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:36.175935 29960 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:09:36.176075 29960 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0"
format_stamp: "Formatted at 2026-08-08 05:09:36 on dist-test-slave-bndk"
server_key: "fbdd5bd1f281721dbb8d24925cde6bc6"
server_key_iv: "82a36f883c4911ebdaf50e4975157c38"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:36.176185 29960 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:09:36.201597 29960 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:09:36.203586 29960 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:09:36.203773 29960 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:09:36.209601 29960 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:45243
I20260808 05:09:36.209640 30055 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:45243 every 8 connection(s)
I20260808 05:09:36.210081 29960 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:09:36.210829 30056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:09:36.213088 30056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0: Bootstrap starting.
I20260808 05:09:36.213683 30056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0: Neither blocks nor log segments found. Creating new log.
I20260808 05:09:36.213953 30056 log.cc:824] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:09:36.214582 30056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0: No bootstrap required, opened a new log
I20260808 05:09:36.216595 30056 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45243 } }
I20260808 05:09:36.216742 30056 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:09:36.216774 30056 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfe9a1f1f8e04eaa9b1e2f6bab7852d0, State: Initialized, Role: FOLLOWER
I20260808 05:09:36.216914 30056 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45243 } }
I20260808 05:09:36.216998 30056 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:09:36.217039 30056 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:09:36.217087 30056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:09:36.217628 30056 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45243 } }
I20260808 05:09:36.217726 30056 leader_election.cc:302] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfe9a1f1f8e04eaa9b1e2f6bab7852d0; no voters:
I20260808 05:09:36.217891 30056 leader_election.cc:288] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:09:36.217928 30060 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:09:36.218062 30060 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [term 1 LEADER]: Becoming Leader. State: Replica: cfe9a1f1f8e04eaa9b1e2f6bab7852d0, State: Running, Role: LEADER
I20260808 05:09:36.218158 30056 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:09:36.218223 30060 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45243 } }
I20260808 05:09:36.218593 30062 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfe9a1f1f8e04eaa9b1e2f6bab7852d0. Latest consensus state: current_term: 1 leader_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45243 } } }
I20260808 05:09:36.218604 30061 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfe9a1f1f8e04eaa9b1e2f6bab7852d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45243 } } }
I20260808 05:09:36.218688 30062 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:09:36.218705 30061 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:09:36.219090 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 29960
I20260808 05:09:36.219189 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:09:36.219383 13292 external_mini_cluster.cc:1428] Setting key d1f771fbd8ab583791a70eb876f441ec
I20260808 05:09:36.218887 30072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:09:36.220165 30072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:09:36.220775 30056 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 05:09:36.221727 30072 catalog_manager.cc:1347] Generated new cluster ID: ddf7de165e9a4b0eaef96b09b8913323
I20260808 05:09:36.221782 30072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:09:36.226210 30072 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:09:36.229902 30072 catalog_manager.cc:1504] Loading token signing keys...
Aug 08 05:09:36 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165775, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:09:36.240268 30084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:36.219849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60296 (local address 127.12.251.62:45243)
0808 05:09:36.225618 (+ 5769us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:36.225628 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:36.225663 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:09:36.225781 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:36.225789 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:36.225847 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:36.226002 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:09:36.228418 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:36.231386 (+ 2968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:36.232511 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:36.233140 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:36.233289 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:36.236174 (+ 2885us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:09:36.236178 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:09:36.236178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:09:36.236192 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:09:36.238200 (+ 2008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:36.238633 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:36.238637 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:36.238637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:36.238739 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:36.238933 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:36.238934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:36.238934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:36.239209 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:09:36.239418 (+ 209us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:36.239852 (+ 434us) server_negotiation.cc:299] Negotiation successful
0808 05:09:36.240008 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5718,"thread_start_us":88,"threads_started":1}
I20260808 05:09:36.244948 30072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0: Generated new TSK 0
I20260808 05:09:36.245123 30072 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:09:36.953356 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:54157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45243
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:09:37.045190 30129 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:09:37.045441 30129 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:09:37.045464 30129 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:09:37.046803 30129 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:09:37.046857 30129 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:09:37.046895 30129 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:09:37.048875 30129 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.251.20:54157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30129
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:09:37.049095 30129 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:09:37.049350 30129 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:09:37.054133 30135 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:09:37.054136 30138 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:09:37.054335 30129 server_base.cc:1034] running on GCE node
W20260808 05:09:37.054452 30136 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:09:37.054625 30129 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:09:37.054960 30129 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:09:37.056109 30129 hybrid_clock.cc:648] HybridClock initialized: now 1786165777056095 us; error 34 us; skew 500 ppm
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:09:37.058765 30129 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:09:37.059242 30129 webserver.cc:460] Webserver started at http://127.12.251.1:41297/ using document root <none> and password file <none>
I20260808 05:09:37.059450 30129 fs_manager.cc:359] Metadata directory not provided
I20260808 05:09:37.059499 30129 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:09:37.059618 30129 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:09:37.078336 30129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "f82c812624284ca7b097e865a71fe098"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "74a8bc97b4625781828d8f5606dfe24c"
server_key_iv: "57ed49155b2134872ebadfd0cd1c1c8a"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.078862 30129 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "f82c812624284ca7b097e865a71fe098"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "74a8bc97b4625781828d8f5606dfe24c"
server_key_iv: "57ed49155b2134872ebadfd0cd1c1c8a"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.080302 30129 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:09:37.092940 30148 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.093130 30129 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:09:37.093256 30129 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "f82c812624284ca7b097e865a71fe098"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "74a8bc97b4625781828d8f5606dfe24c"
server_key_iv: "57ed49155b2134872ebadfd0cd1c1c8a"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.093344 30129 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:09:37.101378 30129 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:09:37.103176 30129 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:09:37.103312 30129 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:09:37.103514 30129 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:09:37.103832 30129 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:09:37.103871 30129 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.103900 30129 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:09:37.103937 30129 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.111063 30129 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:45669
I20260808 05:09:37.111550 30129 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:09:37.112236 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 30129
I20260808 05:09:37.112352 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:09:37.112573 13292 external_mini_cluster.cc:1428] Setting key 5e8296bd9e487daba8a7a57c2cf5c866
I20260808 05:09:37.112607 30316 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:45669 every 8 connection(s)
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
I20260808 05:09:37.142508 30319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.113382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45243 (local address 127.12.251.1:39401)
0808 05:09:37.114383 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.114427 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.115060 (+ 633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.127378 (+ 12318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.127384 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.127628 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:09:37.127935 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.127943 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.128976 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.128990 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.130712 (+ 1722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.130716 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.131245 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.131246 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.131425 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.132034 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:09:37.132045 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:09:37.137690 (+ 5645us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:09:37.140837 (+ 3147us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:09:37.140846 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:09:37.140848 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:09:37.141160 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:09:37.141408 (+ 248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:09:37.141409 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:09:37.141409 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:09:37.141555 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:09:37.141835 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:09:37.141843 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:09:37.142012 (+ 169us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.142103 (+ 91us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.142260 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":960,"thread_start_us":87,"threads_started":1}
I20260808 05:09:37.142846 30326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.122946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:39401 (local address 127.12.251.62:45243)
0808 05:09:37.127073 (+ 4127us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.127075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.127088 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:09:37.127117 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.127118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.127130 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.127221 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:09:37.128050 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.128853 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.130819 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.131147 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.132796 (+ 1649us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.138657 (+ 5861us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:09:37.138659 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:09:37.138659 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:09:37.138668 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:09:37.140721 (+ 2053us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.141268 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.141269 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.141269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.141342 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.141624 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.141624 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.141625 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.141760 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:09:37.142626 (+ 866us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.142688 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.142775 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4086,"thread_start_us":107,"threads_started":1}
I20260808 05:09:37.143224 30317 heartbeater.cc:347] Connected to a master server at 127.12.251.62:45243
I20260808 05:09:37.143322 30317 heartbeater.cc:464] Registering TS with master...
I20260808 05:09:37.143502 30317 heartbeater.cc:511] Master 127.12.251.62:45243 requested a full tablet report, sending...
I20260808 05:09:37.144037 30002 ts_manager.cc:194] Registered new tserver with Master: f82c812624284ca7b097e865a71fe098 (127.12.251.1:45669)
I20260808 05:09:37.144650 30002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:39401
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:09:37.165395 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:54157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45243
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:09:37.277807 30330 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:09:37.278000 30330 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:09:37.278029 30330 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:09:37.279126 30330 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:09:37.279167 30330 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:09:37.279201 30330 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:09:37.280653 30330 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.251.20:54157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30330
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:09:37.280877 30330 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:09:37.281095 30330 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:09:37.285964 30346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:09:37.286192 30339 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:09:37.285959 30343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:09:37.286816 30330 server_base.cc:1034] running on GCE node
I20260808 05:09:37.287014 30330 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:09:37.287230 30330 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:09:37.290513 30330 hybrid_clock.cc:648] HybridClock initialized: now 1786165777290488 us; error 30 us; skew 500 ppm
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:09:37.293123 30330 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:09:37.293591 30330 webserver.cc:460] Webserver started at http://127.12.251.2:39517/ using document root <none> and password file <none>
I20260808 05:09:37.293803 30330 fs_manager.cc:359] Metadata directory not provided
I20260808 05:09:37.293852 30330 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:09:37.293988 30330 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:09:37.309322 30330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "06bd0053e42b454dbe9729432bdb08e4"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "577b8f270b4f174d788209dbd8b22776"
server_key_iv: "fc5fc17d08556eb9faf6116b43071c73"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.309801 30330 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "06bd0053e42b454dbe9729432bdb08e4"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "577b8f270b4f174d788209dbd8b22776"
server_key_iv: "fc5fc17d08556eb9faf6116b43071c73"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.311585 30330 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:09:37.327531 30356 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.327704 30330 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:09:37.327800 30330 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "06bd0053e42b454dbe9729432bdb08e4"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "577b8f270b4f174d788209dbd8b22776"
server_key_iv: "fc5fc17d08556eb9faf6116b43071c73"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.327900 30330 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:09:37.364140 30330 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:09:37.366458 30330 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:09:37.366616 30330 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:09:37.366890 30330 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:09:37.367283 30330 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:09:37.367347 30330 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.367381 30330 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:09:37.367403 30330 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.374889 30330 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:32987
I20260808 05:09:37.375348 30330 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:09:37.380436 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 30330
I20260808 05:09:37.380556 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:09:37.380762 13292 external_mini_cluster.cc:1428] Setting key 7d51a50d21653d6752a823f1f2980d5c
I20260808 05:09:37.386942 30518 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:32987 every 8 connection(s)
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
I20260808 05:09:37.398764 30326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.387791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:49757 (local address 127.12.251.62:45243)
0808 05:09:37.387865 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.387867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.388101 (+ 234us) server_negotiation.cc:407] Connection header received
0808 05:09:37.388762 (+ 661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.388763 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.388777 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.388836 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:09:37.389788 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.390597 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.392154 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.392493 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.392560 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.395629 (+ 3069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:09:37.395631 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:09:37.395631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:09:37.395638 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:09:37.397272 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.397736 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.397737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.397738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.397791 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.398037 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.398038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.398038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.398174 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:09:37.398213 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.398570 (+ 357us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.398660 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260808 05:09:37.399274 30522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.387769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45243 (local address 127.12.251.2:49757)
0808 05:09:37.387966 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.388010 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.388663 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.388918 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.388922 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.389189 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:09:37.389665 (+ 476us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.389674 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.390718 (+ 1044us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.390719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.392062 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.392065 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.392629 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.392631 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.392777 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.393861 (+ 1084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:09:37.393873 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:09:37.395522 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:09:37.397367 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:09:37.397374 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:09:37.397376 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:09:37.397654 (+ 278us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:09:37.397854 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:09:37.397855 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:09:37.397855 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:09:37.397973 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:09:37.398254 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:09:37.398260 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:09:37.398430 (+ 170us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.398886 (+ 456us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.399042 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":125,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
I20260808 05:09:37.399801 30519 heartbeater.cc:347] Connected to a master server at 127.12.251.62:45243
I20260808 05:09:37.399919 30519 heartbeater.cc:464] Registering TS with master...
I20260808 05:09:37.400112 30519 heartbeater.cc:511] Master 127.12.251.62:45243 requested a full tablet report, sending...
I20260808 05:09:37.400556 30002 ts_manager.cc:194] Registered new tserver with Master: 06bd0053e42b454dbe9729432bdb08e4 (127.12.251.2:32987)
I20260808 05:09:37.401044 30002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:49757
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:09:37.421691 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:54157/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45243
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36399
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:09:37.546000 30525 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:09:37.546365 30525 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:09:37.546458 30525 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:09:37.548082 30525 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:09:37.548142 30525 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:09:37.548180 30525 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:09:37.550333 30525 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36399
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.251.20:54157/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:45243
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30525
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:09:37.551712 30525 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:09:37.551999 30525 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:09:37.558585 30543 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:09:37.558765 30536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:09:37.559007 30525 server_base.cc:1034] running on GCE node
W20260808 05:09:37.559015 30533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:09:37.559327 30525 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:09:37.559594 30525 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:09:37.560761 30525 hybrid_clock.cc:648] HybridClock initialized: now 1786165777560741 us; error 31 us; skew 500 ppm
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:09:37.564033 30525 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:09:37.564597 30525 webserver.cc:460] Webserver started at http://127.12.251.3:40151/ using document root <none> and password file <none>
I20260808 05:09:37.564859 30525 fs_manager.cc:359] Metadata directory not provided
I20260808 05:09:37.564935 30525 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:09:37.565083 30525 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:09:37.582618 30525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "13ce690ccaf94574b604f2fef5f084f1"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "59e848914d4e9d3b1a85fef81d944162"
server_key_iv: "66de1559c9f0690e93565504e16f5649"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.583168 30525 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "13ce690ccaf94574b604f2fef5f084f1"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "59e848914d4e9d3b1a85fef81d944162"
server_key_iv: "66de1559c9f0690e93565504e16f5649"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.585249 30525 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:09:37.601369 30553 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.601552 30525 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:09:37.601651 30525 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "13ce690ccaf94574b604f2fef5f084f1"
format_stamp: "Formatted at 2026-08-08 05:09:37 on dist-test-slave-bndk"
server_key: "59e848914d4e9d3b1a85fef81d944162"
server_key_iv: "66de1559c9f0690e93565504e16f5649"
server_key_version: "kuduclusterkey@0"
I20260808 05:09:37.601750 30525 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:09:37.618434 30525 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:09:37.620764 30525 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:09:37.620903 30525 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:09:37.621105 30525 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:09:37.621502 30525 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:09:37.621555 30525 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.621585 30525 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:09:37.621608 30525 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:09:37.632119 30525 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:39269
I20260808 05:09:37.632563 30525 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:09:37.634830 30713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:39269 every 8 connection(s)
I20260808 05:09:37.639585 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 30525
I20260808 05:09:37.639699 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:09:37.639894 13292 external_mini_cluster.cc:1428] Setting key 73c262bb6764b71130afd4d237be6b48
Aug 08 05:09:37 dist-test-slave-bndk krb5kdc[29284](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165777, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:09:37.646720 30326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.635958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:41273 (local address 127.12.251.62:45243)
0808 05:09:37.636015 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.636017 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.636354 (+ 337us) server_negotiation.cc:407] Connection header received
0808 05:09:37.637096 (+ 742us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.637098 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.637111 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.637144 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:09:37.638026 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.638837 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.641888 (+ 3051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.642089 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.642147 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.644218 (+ 2071us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:09:37.644219 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:09:37.644220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:09:37.644227 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:09:37.645499 (+ 1272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.645862 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.645863 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.645863 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.645915 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.646134 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.646135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.646135 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.646240 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:09:37.646296 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.646552 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.646631 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:09:37.646891 30722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.635646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:45243 (local address 127.12.251.3:41273)
0808 05:09:37.636228 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.636267 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.636934 (+ 667us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.637364 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.637369 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.637619 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:09:37.637900 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.637907 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.638948 (+ 1041us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.638949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.641781 (+ 2832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.641783 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.642164 (+ 381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.642165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.642305 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.642788 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:09:37.642805 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:09:37.644134 (+ 1329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:09:37.645571 (+ 1437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:09:37.645578 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:09:37.645581 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:09:37.645790 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:09:37.645969 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:09:37.645969 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:09:37.645970 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:09:37.646078 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:09:37.646295 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:09:37.646302 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:09:37.646435 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.646523 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.646662 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":119,"threads_started":1}
I20260808 05:09:37.647257 30714 heartbeater.cc:347] Connected to a master server at 127.12.251.62:45243
I20260808 05:09:37.647338 30714 heartbeater.cc:464] Registering TS with master...
I20260808 05:09:37.647503 30714 heartbeater.cc:511] Master 127.12.251.62:45243 requested a full tablet report, sending...
I20260808 05:09:37.647869 30002 ts_manager.cc:194] Registered new tserver with Master: 13ce690ccaf94574b604f2fef5f084f1 (127.12.251.3:39269)
I20260808 05:09:37.648214 30002 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:41273
I20260808 05:09:37.651558 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:09:37.658493 30326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.652963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45380 (local address 127.12.251.62:45243)
0808 05:09:37.653000 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.653002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.653160 (+ 158us) server_negotiation.cc:407] Connection header received
0808 05:09:37.653202 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.653203 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.653231 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.653283 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:09:37.653818 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.654276 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.654974 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.655165 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.655218 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.656276 (+ 1058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:09:37.656277 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:09:37.656277 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:09:37.656284 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:09:37.657542 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.657836 (+ 294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.657837 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.657838 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.657888 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:09:37.658050 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:09:37.658050 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:09:37.658051 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:09:37.658149 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:09:37.658232 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.658332 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.658404 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:09:37.660166 30002 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45380:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:09:37.661896 30002 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:09:37.669451 30738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.664242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:39269 (local address 127.0.0.1:44336)
0808 05:09:37.664812 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.664821 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.664863 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.665164 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.665164 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.665166 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:09:37.665269 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.665271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.666753 (+ 1482us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.666754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.668189 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.668192 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.669156 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.669157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.669263 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.669281 (+ 18us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.669327 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.669377 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"mutex_wait_us":66,"thread_start_us":91,"threads_started":1}
I20260808 05:09:37.669557 30736 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.664211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:32987 (local address 127.0.0.1:48218)
0808 05:09:37.664661 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.664703 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.664774 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.665158 (+ 384us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.665161 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.665164 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:09:37.665340 (+ 176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.665342 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.666724 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.666725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.668184 (+ 1459us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.668188 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.669297 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.669298 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.669378 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.669382 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.669436 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.669480 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":421,"mutex_wait_us":177,"thread_start_us":91,"threads_started":1}
I20260808 05:09:37.669804 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.664330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48218 (local address 127.12.251.2:32987)
0808 05:09:37.664590 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.664596 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.664861 (+ 265us) server_negotiation.cc:407] Connection header received
0808 05:09:37.664908 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.664911 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.664927 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.665068 (+ 141us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:09:37.665403 (+ 335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.666609 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.668308 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.669056 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.669131 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.669257 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.669677 (+ 420us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.669722 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":86,"threads_started":1}
I20260808 05:09:37.669890 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.664510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44336 (local address 127.12.251.3:39269)
0808 05:09:37.664997 (+ 487us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.665001 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.665010 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:09:37.665046 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.665048 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.665063 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.665433 (+ 370us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:09:37.665512 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.666647 (+ 1135us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.668296 (+ 1649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.669055 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.669639 (+ 584us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.669736 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.669765 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.669805 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":448,"thread_start_us":97,"threads_started":1}
I20260808 05:09:37.670513 30735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.664441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:45669 (local address 127.0.0.1:56006)
0808 05:09:37.665254 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.665263 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.665314 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.665617 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.665618 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.665620 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:09:37.665653 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.665654 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.666916 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.666916 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.668336 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.668338 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.670279 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.670282 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.670353 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.670358 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.670414 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.670451 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":74,"threads_started":1}
I20260808 05:09:37.670495 30625 tablet_service.cc:1467] Processing CreateTablet for tablet 31342ff97a1145d6b6825d1fccd48d07 (DEFAULT_TABLE table=test-table [id=a1df54c7f722474e83b3be44d7a8bf0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:09:37.670527 30414 tablet_service.cc:1467] Processing CreateTablet for tablet 31342ff97a1145d6b6825d1fccd48d07 (DEFAULT_TABLE table=test-table [id=a1df54c7f722474e83b3be44d7a8bf0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:09:37.670781 30625 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31342ff97a1145d6b6825d1fccd48d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:09:37.670892 30414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31342ff97a1145d6b6825d1fccd48d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:09:37.671066 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.664648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56006 (local address 127.12.251.1:45669)
0808 05:09:37.664800 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.664805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.665373 (+ 568us) server_negotiation.cc:407] Connection header received
0808 05:09:37.665468 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.665471 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.665487 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.665554 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:09:37.665718 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.666838 (+ 1120us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.668416 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.669069 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.669126 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.669186 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.670902 (+ 1716us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.671001 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":63,"threads_started":1}
I20260808 05:09:37.671787 30217 tablet_service.cc:1467] Processing CreateTablet for tablet 31342ff97a1145d6b6825d1fccd48d07 (DEFAULT_TABLE table=test-table [id=a1df54c7f722474e83b3be44d7a8bf0b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:09:37.672102 30217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 31342ff97a1145d6b6825d1fccd48d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:09:37.674346 30743 tablet_bootstrap.cc:492] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Bootstrap starting.
I20260808 05:09:37.675470 30743 tablet_bootstrap.cc:654] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Neither blocks nor log segments found. Creating new log.
I20260808 05:09:37.675374 30744 tablet_bootstrap.cc:492] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098: Bootstrap starting.
I20260808 05:09:37.675840 30743 log.cc:824] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:09:37.676266 30744 tablet_bootstrap.cc:654] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098: Neither blocks nor log segments found. Creating new log.
I20260808 05:09:37.676257 30742 tablet_bootstrap.cc:492] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Bootstrap starting.
I20260808 05:09:37.676628 30744 log.cc:824] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098: Log is configured to *not* fsync() on all Append() calls
I20260808 05:09:37.677157 30742 tablet_bootstrap.cc:654] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Neither blocks nor log segments found. Creating new log.
I20260808 05:09:37.677479 30744 tablet_bootstrap.cc:492] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098: No bootstrap required, opened a new log
I20260808 05:09:37.677512 30742 log.cc:824] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:09:37.677549 30744 ts_tablet_manager.cc:1397] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:09:37.678061 30743 tablet_bootstrap.cc:492] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: No bootstrap required, opened a new log
I20260808 05:09:37.678121 30743 ts_tablet_manager.cc:1397] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260808 05:09:37.679800 30743 raft_consensus.cc:348] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.679975 30743 raft_consensus.cc:374] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:09:37.680018 30743 raft_consensus.cc:729] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13ce690ccaf94574b604f2fef5f084f1, State: Initialized, Role: FOLLOWER
I20260808 05:09:37.680153 30743 consensus_queue.cc:260] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.680121 30744 raft_consensus.cc:348] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.680269 30744 raft_consensus.cc:374] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:09:37.680320 30744 raft_consensus.cc:729] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f82c812624284ca7b097e865a71fe098, State: Initialized, Role: FOLLOWER
I20260808 05:09:37.680511 30743 ts_tablet_manager.cc:1428] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:09:37.680546 30714 heartbeater.cc:503] Master 127.12.251.62:45243 was elected leader, sending a full tablet report...
I20260808 05:09:37.680866 30742 tablet_bootstrap.cc:492] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: No bootstrap required, opened a new log
I20260808 05:09:37.680923 30742 ts_tablet_manager.cc:1397] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.001s
I20260808 05:09:37.680445 30744 consensus_queue.cc:260] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.681902 30744 ts_tablet_manager.cc:1428] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 05:09:37.681933 30317 heartbeater.cc:503] Master 127.12.251.62:45243 was elected leader, sending a full tablet report...
I20260808 05:09:37.682969 30742 raft_consensus.cc:348] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.683084 30742 raft_consensus.cc:374] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:09:37.683113 30742 raft_consensus.cc:729] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06bd0053e42b454dbe9729432bdb08e4, State: Initialized, Role: FOLLOWER
I20260808 05:09:37.683215 30742 consensus_queue.cc:260] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.683454 30742 ts_tablet_manager.cc:1428] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260808 05:09:37.683482 30519 heartbeater.cc:503] Master 127.12.251.62:45243 was elected leader, sending a full tablet report...
I20260808 05:09:37.701395 30749 raft_consensus.cc:482] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:09:37.701535 30749 raft_consensus.cc:504] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.701912 30749 leader_election.cc:288] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06bd0053e42b454dbe9729432bdb08e4 (127.12.251.2:32987), f82c812624284ca7b097e865a71fe098 (127.12.251.1:45669)
I20260808 05:09:37.709918 30722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.705118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:32987 (local address 127.12.251.3:48437)
0808 05:09:37.705569 (+ 451us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.705581 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.705629 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.706217 (+ 588us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.706218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.706220 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:09:37.706294 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.706296 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.707279 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.707280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.708500 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.708502 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.709654 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.709655 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.709737 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.709742 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.709793 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.709844 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431}
I20260808 05:09:37.710186 30737 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.706028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:48437 (local address 127.12.251.2:32987)
0808 05:09:37.706067 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.706069 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.706077 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:09:37.706104 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.706105 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.706115 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.706165 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:09:37.706368 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.707139 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.708636 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.709176 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.709272 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.709284 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.710076 (+ 792us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.710121 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:09:37.710467 30455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31342ff97a1145d6b6825d1fccd48d07" candidate_uuid: "13ce690ccaf94574b604f2fef5f084f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06bd0053e42b454dbe9729432bdb08e4" is_pre_election: true
I20260808 05:09:37.710625 30455 raft_consensus.cc:2454] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13ce690ccaf94574b604f2fef5f084f1 in term 0.
I20260808 05:09:37.710861 30557 leader_election.cc:302] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06bd0053e42b454dbe9729432bdb08e4, 13ce690ccaf94574b604f2fef5f084f1; no voters:
I20260808 05:09:37.710989 30749 raft_consensus.cc:2781] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:09:37.711026 30749 raft_consensus.cc:482] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:09:37.711045 30749 raft_consensus.cc:3037] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:09:37.711977 30749 raft_consensus.cc:504] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.712106 30749 leader_election.cc:288] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [CANDIDATE]: Term 1 election: Requested vote from peers 06bd0053e42b454dbe9729432bdb08e4 (127.12.251.2:32987), f82c812624284ca7b097e865a71fe098 (127.12.251.1:45669)
I20260808 05:09:37.712285 30455 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31342ff97a1145d6b6825d1fccd48d07" candidate_uuid: "13ce690ccaf94574b604f2fef5f084f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06bd0053e42b454dbe9729432bdb08e4"
I20260808 05:09:37.712354 30455 raft_consensus.cc:3037] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:09:37.713241 30455 raft_consensus.cc:2454] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13ce690ccaf94574b604f2fef5f084f1 in term 1.
I20260808 05:09:37.714030 30741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.705800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:56789 (local address 127.12.251.1:45669)
0808 05:09:37.705952 (+ 152us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.705954 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.707429 (+ 1475us) server_negotiation.cc:407] Connection header received
0808 05:09:37.707527 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.707528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.707537 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.707563 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:09:37.707755 (+ 192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.708445 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.712975 (+ 4530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.713580 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.713628 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.713636 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.713917 (+ 281us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.713961 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260808 05:09:37.714423 30752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.705208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:45669 (local address 127.12.251.3:56789)
0808 05:09:37.707367 (+ 2159us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.707377 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:09:37.707455 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:09:37.707619 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:09:37.707620 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:09:37.707622 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:09:37.707686 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.707687 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.708541 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.708542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.712869 (+ 4327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:09:37.712872 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.713769 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.713770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:09:37.713843 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.713847 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:09:37.714277 (+ 430us) client_negotiation.cc:240] Negotiation successful
0808 05:09:37.714319 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2137,"thread_start_us":235,"threads_started":1}
I20260808 05:09:37.714847 30252 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31342ff97a1145d6b6825d1fccd48d07" candidate_uuid: "13ce690ccaf94574b604f2fef5f084f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82c812624284ca7b097e865a71fe098" is_pre_election: true
I20260808 05:09:37.715004 30252 raft_consensus.cc:2454] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 13ce690ccaf94574b604f2fef5f084f1 in term 0.
I20260808 05:09:37.715108 30248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "31342ff97a1145d6b6825d1fccd48d07" candidate_uuid: "13ce690ccaf94574b604f2fef5f084f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f82c812624284ca7b097e865a71fe098"
I20260808 05:09:37.715157 30248 raft_consensus.cc:3037] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:09:37.715950 30248 raft_consensus.cc:2454] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 13ce690ccaf94574b604f2fef5f084f1 in term 1.
I20260808 05:09:37.716262 30557 leader_election.cc:302] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13ce690ccaf94574b604f2fef5f084f1, f82c812624284ca7b097e865a71fe098; no voters:
I20260808 05:09:37.716389 30749 raft_consensus.cc:2781] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:09:37.716548 30749 raft_consensus.cc:686] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 1 LEADER]: Becoming Leader. State: Replica: 13ce690ccaf94574b604f2fef5f084f1, State: Running, Role: LEADER
I20260808 05:09:37.716629 30749 consensus_queue.cc:237] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } }
I20260808 05:09:37.717432 30002 catalog_manager.cc:5495] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 13ce690ccaf94574b604f2fef5f084f1 (127.12.251.3). New cstate: current_term: 1 leader_uuid: "13ce690ccaf94574b604f2fef5f084f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "13ce690ccaf94574b604f2fef5f084f1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 39269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 } health_report { overall_health: UNKNOWN } } }
I20260808 05:09:37.723713 30739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.720969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44342 (local address 127.12.251.3:39269)
0808 05:09:37.721004 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:09:37.721006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:09:37.721014 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:09:37.721083 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:09:37.721083 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:09:37.721101 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:09:37.721163 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:09:37.721340 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.722035 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.723007 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:09:37.723208 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:09:37.723261 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:09:37.723423 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:09:37.723522 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:09:37.723592 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:09:37.723628 (+ 36us) server_negotiation.cc:299] Negotiation successful
0808 05:09:37.723646 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:09:37.725415 30248 raft_consensus.cc:1261] T 31342ff97a1145d6b6825d1fccd48d07 P f82c812624284ca7b097e865a71fe098 [term 1 FOLLOWER]: Refusing update from remote peer 13ce690ccaf94574b604f2fef5f084f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:09:37.725451 30455 raft_consensus.cc:1261] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 1 FOLLOWER]: Refusing update from remote peer 13ce690ccaf94574b604f2fef5f084f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:09:37.725760 30753 consensus_queue.cc:1035] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f82c812624284ca7b097e865a71fe098" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 45669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:09:37.725864 30749 consensus_queue.cc:1035] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "06bd0053e42b454dbe9729432bdb08e4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32987 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:09:37.728502 30757 mvcc.cc:205] Tried to move back new op lower bound from 7316135025560989696 to 7316135025527889920. Current Snapshot: MvccSnapshot[applied={T|T < 7316135025560989696}]
I20260808 05:09:37.730491 30760 mvcc.cc:205] Tried to move back new op lower bound from 7316135025560989696 to 7316135025527889920. Current Snapshot: MvccSnapshot[applied={T|T < 7316135025560989696}]
I20260808 05:09:37.730681 30763 mvcc.cc:205] Tried to move back new op lower bound from 7316135025560989696 to 7316135025527889920. Current Snapshot: MvccSnapshot[applied={T|T < 7316135025560989696}]
I20260808 05:09:37.733209 30001 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:09:37.733346 30001 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45380:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:09:37.734079 30001 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfe9a1f1f8e04eaa9b1e2f6bab7852d0: Sending DeleteTablet for 3 replicas of tablet 31342ff97a1145d6b6825d1fccd48d07
I20260808 05:09:37.734411 30625 tablet_service.cc:1514] Processing DeleteTablet for tablet 31342ff97a1145d6b6825d1fccd48d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:09:37 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:44336
I20260808 05:09:37.734561 30414 tablet_service.cc:1514] Processing DeleteTablet for tablet 31342ff97a1145d6b6825d1fccd48d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:09:37 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:48218
I20260808 05:09:37.734745 30217 tablet_service.cc:1514] Processing DeleteTablet for tablet 31342ff97a1145d6b6825d1fccd48d07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:09:37 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:56006
I20260808 05:09:37.735235 30773 tablet_replica.cc:330] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: stopping tablet replica
I20260808 05:09:37.735324 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 30129
I20260808 05:09:37.735383 30773 raft_consensus.cc:2229] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:09:37.735502 30773 raft_consensus.cc:2258] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:09:37.742458 30774 tablet_replica.cc:330] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: stopping tablet replica
I20260808 05:09:37.742579 30774 raft_consensus.cc:2229] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:09:37.742692 30774 raft_consensus.cc:2258] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:09:37.759183 30774 ts_tablet_manager.cc:1905] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:09:37.761287 30774 ts_tablet_manager.cc:1918] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:09:37.761396 30774 log.cc:1196] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/31342ff97a1145d6b6825d1fccd48d07
I20260808 05:09:37.762122 30774 ts_tablet_manager.cc:1939] T 31342ff97a1145d6b6825d1fccd48d07 P 06bd0053e42b454dbe9729432bdb08e4: Deleting consensus metadata
I20260808 05:09:37.762794 29983 catalog_manager.cc:4841] TS 06bd0053e42b454dbe9729432bdb08e4 (127.12.251.2:32987): tablet 31342ff97a1145d6b6825d1fccd48d07 (table test-table [id=a1df54c7f722474e83b3be44d7a8bf0b]) successfully deleted
I20260808 05:09:37.764490 30773 ts_tablet_manager.cc:1905] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:09:37.766533 30773 ts_tablet_manager.cc:1918] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:09:37.766620 30773 log.cc:1196] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/31342ff97a1145d6b6825d1fccd48d07
I20260808 05:09:37.766964 30773 ts_tablet_manager.cc:1939] T 31342ff97a1145d6b6825d1fccd48d07 P 13ce690ccaf94574b604f2fef5f084f1: Deleting consensus metadata
I20260808 05:09:37.767499 29982 catalog_manager.cc:4841] TS 13ce690ccaf94574b604f2fef5f084f1 (127.12.251.3:39269): tablet 31342ff97a1145d6b6825d1fccd48d07 (table test-table [id=a1df54c7f722474e83b3be44d7a8bf0b]) successfully deleted
W20260808 05:09:37.778072 29983 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:45669 (error 108)
I20260808 05:09:37.778885 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 30330
I20260808 05:09:37.779173 30735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:09:37.779010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:45669 (local address 127.0.0.1:56022)
0808 05:09:37.779070 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:09:37.779131 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:45669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260808 05:09:37.782204 29983 catalog_manager.cc:4584] TS f82c812624284ca7b097e865a71fe098 (127.12.251.1:45669): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 31342ff97a1145d6b6825d1fccd48d07: Network error: Client connection negotiation failed: client connection to 127.12.251.1:45669: connect: Connection refused (error 111)
I20260808 05:09:37.787547 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 30525
I20260808 05:09:37.812093 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 29960
I20260808 05:09:37.825147 13292 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 05:09:38.168746 13292 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 05:09:38.168876 13292 mini_ranger.cc:66] Stopping Ranger...
I20260808 05:09:38.512671 13292 mini_ranger.cc:68] Stopped Ranger
2026-08-08 05:09:38.512 UTC [29333] LOG: received smart shutdown request
2026-08-08 05:09:38.515 UTC [29333] LOG: background worker "logical replication launcher" (PID 29347) exited with exit code 1
2026-08-08 05:09:38.515 UTC [29339] LOG: shutting down
2026-08-08 05:09:38.659 UTC [29333] LOG: database system is shut down
2026-08-08T05:09:38Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46136 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:09:38 dist-test-slave-bndk krb5kdc[30787](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:09:38 dist-test-slave-bndk krb5kdc[30787](info): set up 2 sockets
Aug 08 05:09:38 dist-test-slave-bndk krb5kdc[30787](info): commencing operation
krb5kdc: starting...
W20260808 05:09:39.885728 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.004s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:09:39 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165779, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:09:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:09:39Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/rangeradmin_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/rangeradmin_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/rangerlookup_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/rangerlookup_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
I20260808 05:09:40.041949 13292 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskTWVJbZ/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/postgres -l logfile start
2026-08-08 05:09:42.288 UTC [30837] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-08 05:09:42.288 UTC [30837] LOG: listening on IPv4 address "127.12.251.20", port 48947
2026-08-08 05:09:42.291 UTC [30837] LOG: listening on Unix socket "/tmp/.s.PGSQL.48947"
2026-08-08 05:09:42.318 UTC [30840] LOG: database system was shut down at 2026-08-08 05:09:41 UTC
2026-08-08 05:09:42.322 UTC [30837] LOG: database system is ready to accept connections
I20260808 05:09:43.365959 13292 mini_postgres.cc:96] Postgres bound to 48947
2026-08-08 05:09:43.372 UTC [30853] FATAL: database "slave" does not exist
127.12.251.20:48947 - accepting connections
I20260808 05:09:43.373260 13292 mini_ranger.cc:161] Starting Ranger...
I20260808 05:09:43.387753 13292 mini_ranger.cc:84] Created miniranger Postgres user
I20260808 05:09:43.815201 13292 mini_ranger.cc:87] Created ranger Postgres database
I20260808 05:09:43.815275 13292 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-admin
2026-08-08 05:09:44,085 [I] DB FLAVOR :POSTGRES
2026-08-08 05:09:44,085 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:09:44,085 [I] Checking connection..
2026-08-08 05:09:44,085 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-08 05:09:44,350 [I] Checking connection passed.
2026-08-08 05:09:44,350 [I] --------- Verifying version history table ---------
2026-08-08 05:09:44,350 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:09:44,584 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:09:44,585 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:09:44,819 [I] Table x_db_version_h does not exist in database ranger
2026-08-08 05:09:44,819 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-08 05:09:44,819 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-08 05:09:45.041 UTC [30943] WARNING: there is no transaction in progress
2026-08-08 05:09:45,048 [I] create_dbversion_catalog.sql file imported successfully
2026-08-08 05:09:45,048 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-08 05:09:45,282 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-08 05:09:45,282 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:09:45,282 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-08 05:09:45,531 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-08 05:09:45,771 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-bndk.c.gcp-upstream.internal','N') ;"
2026-08-08 05:09:46,016 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:09:46,275 [I] Table x_portal_user does not exist in database ranger
2026-08-08 05:09:46,275 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:09:46,532 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-08 05:09:46,533 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:09:46,769 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:09:47,003 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-08 05:09:47,003 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-08 05:09:47.907 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:47.922 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:47.937 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:47.951 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:47.965 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:47.980 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.030 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.036 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.049 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.058 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.067 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.080 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.089 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.095 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.100 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48.106 UTC [31119] WARNING: there is no transaction in progress
2026-08-08 05:09:48,676 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-08 05:09:48,677 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-08 05:09:48,924 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-08 05:09:48,924 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-08 05:09:49,170 [I] Table x_portal_user already exists in database 'ranger'
2026-08-08 05:09:49,171 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-08 05:09:49,426 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-08 05:09:49,426 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-08 05:09:49,687 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-08 05:09:49,939 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-bndk.c.gcp-upstream.internal';"
2026-08-08 05:09:50,190 [I] CORE_DB_SCHEMA import status has been updated
2026-08-08 05:09:50,190 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-08 05:09:50,430 [I] DB_PATCHES have already been applied
I20260808 05:09:50.436288 13292 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-admin:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskTWVJbZ/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260808 05:09:50.436352 13292 mini_ranger.cc:193] Using host: 127.12.251.20
I20260808 05:09:50.440166 13292 mini_ranger.cc:227] Ranger admin URL: http://127.12.251.20:44399
Aug 08, 2026 5:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp
Aug 08, 2026 5:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 08, 2026 5:09:50 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 08, 2026 5:09:51 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-admin/ews/webapp].
Aug 08, 2026 5:09:51 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260808 05:09:51.624928 13292 mini_ranger.cc:160] Time spent starting Ranger: real 8.252s user 0.000s sys 0.009s
Aug 08, 2026 5:10:11 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 08, 2026 5:10:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.MetricsREST
Aug 08, 2026 5:10:11 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 08, 2026 5:10:11 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 08, 2026 5:10:12 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260808 05:10:12.775874 13292 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.251.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.251.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/rangerkms_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.251.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/rangerkms_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.251.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.251.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.251.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/HTTP_127.12.251.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 08 05:10:12 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165812, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260808 05:10:12.857714 13292 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260808 05:10:12.867220 13292 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260808 05:10:13.638527 13292 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260808 05:10:13.638600 13292 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms
I20260808 05:10:13.638612 13292 mini_ranger_kms.cc:227] Using postgres at 127.12.251.20:48947
2026-08-08 05:10:13,801 [I] DB FLAVOR :POSTGRES
2026-08-08 05:10:13,801 [I] --------- Verifying Ranger DB connection ---------
2026-08-08 05:10:13,801 [I] Checking connection
2026-08-08 05:10:13,801 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-08 05:10:14,036 [I] connection success
2026-08-08 05:10:14,037 [I] --------- Verifying Ranger DB tables ---------
2026-08-08 05:10:14,037 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-08 05:10:14,037 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-08 05:10:14,301 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-08 05:10:14,301 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-08 05:10:14,302 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-08 05:10:14,302 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.251.20:48947/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-08 05:10:14,560 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260808 05:10:15.014467 13292 mini_ranger_kms.cc:310] Created kms service
I20260808 05:10:15.217592 13292 mini_ranger_kms.cc:326] Created kudu user
I20260808 05:10:15.261831 13292 mini_ranger_kms.cc:343] Created rangerkms user
Aug 08 05:10:15 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165812, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:15.631695 13292 mini_ranger_kms.cc:384] Added ranger policy
I20260808 05:10:15.631896 13292 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms:/tmp/dist-test-taskTWVJbZ/build/release/bin/postgresql.jar:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskTWVJbZ/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260808 05:10:15.631924 13292 mini_ranger_kms.cc:240] Using host: 127.12.251.20
I20260808 05:10:15.636013 13292 mini_ranger_kms.cc:276] Ranger KMS PID: 31396
I20260808 05:10:15.636092 13292 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.251.20:37523
Aug 08, 2026 5:10:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 08, 2026 5:10:16 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 08, 2026 5:10:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 08, 2026 5:10:16 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 08, 2026 5:10:17 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-kms/ews/webapp].
Aug 08, 2026 5:10:17 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 08 05:10:17 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165817, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.251.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:18.131532 13292 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.274s user 0.004s sys 0.144s
I20260808 05:10:18.131651 13292 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260808 05:10:18.131700 13292 mini_ranger_kms.cc:401] 127.12.251.20:37523/kms/v1/keys
Aug 08 05:10:18 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165817, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.251.20@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
Aug 08 05:10:18 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165817, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.251.20@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
Aug 08 05:10:20 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:10:20.738169 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:46343
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:46343
--ranger_config_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:20.820595 31474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:20.820798 31474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:20.820819 31474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:20.822039 31474 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:20.822080 31474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:20.822093 31474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:20.822104 31474 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:20.822115 31474 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:20.823693 31474 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.251.20:37523/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:46343
--ranger_config_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:46343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:20.823921 31474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:20.824134 31474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:20.830102 31480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:20.830193 31482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:20.830255 31474 server_base.cc:1034] running on GCE node
W20260808 05:10:20.830343 31485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:20.830667 31474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:20.831023 31474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:20.832203 31474 hybrid_clock.cc:648] HybridClock initialized: now 1786165820832184 us; error 35 us; skew 500 ppm
Aug 08 05:10:20 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165820, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:20.835276 31474 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:20.835804 31474 webserver.cc:460] Webserver started at http://127.12.251.62:42431/ using document root <none> and password file <none>
I20260808 05:10:20.836072 31474 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:20.836128 31474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:20.836262 31474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:10:20 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165820, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:20.888779 31474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7"
format_stamp: "Formatted at 2026-08-08 05:10:20 on dist-test-slave-bndk"
server_key: "ff5ff5d1c6c77b978a3d61e3c41be988"
server_key_iv: "e0fcfdd58c49fef530f1c022107aa6cc"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:20.889274 31474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7"
format_stamp: "Formatted at 2026-08-08 05:10:20 on dist-test-slave-bndk"
server_key: "ff5ff5d1c6c77b978a3d61e3c41be988"
server_key_iv: "e0fcfdd58c49fef530f1c022107aa6cc"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:20.891031 31474 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260808 05:10:20.905915 31495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:20.906137 31474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:10:20.906245 31474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7"
format_stamp: "Formatted at 2026-08-08 05:10:20 on dist-test-slave-bndk"
server_key: "ff5ff5d1c6c77b978a3d61e3c41be988"
server_key_iv: "e0fcfdd58c49fef530f1c022107aa6cc"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:20.906335 31474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:20.926040 31474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:20.927912 31474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:20.928068 31474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:20.933007 31474 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:46343
I20260808 05:10:20.933040 31571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:46343 every 8 connection(s)
I20260808 05:10:20.933501 31474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:20.934223 31572 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:20.935856 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 31474
I20260808 05:10:20.935981 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:10:20.936187 13292 external_mini_cluster.cc:1428] Setting key d575dffbeced51bda0174bc9ee31c3a2
I20260808 05:10:20.936656 31572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Bootstrap starting.
I20260808 05:10:20.937476 31572 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:20.937829 31572 log.cc:824] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:20.938560 31572 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: No bootstrap required, opened a new log
I20260808 05:10:20.940840 31572 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:20.940991 31572 raft_consensus.cc:374] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:20.941028 31572 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cf5df5e54f43ebb49d5641a7f3c7e7, State: Initialized, Role: FOLLOWER
I20260808 05:10:20.941170 31572 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:20.941274 31572 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:10:20.941329 31572 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:10:20.941401 31572 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:20.941936 31572 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:20.942097 31572 leader_election.cc:302] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0cf5df5e54f43ebb49d5641a7f3c7e7; no voters:
I20260808 05:10:20.942272 31572 leader_election.cc:288] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:10:20.942323 31588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:20.942454 31588 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 LEADER]: Becoming Leader. State: Replica: d0cf5df5e54f43ebb49d5641a7f3c7e7, State: Running, Role: LEADER
I20260808 05:10:20.942564 31588 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:20.942570 31572 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:20.942915 31588 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } } }
I20260808 05:10:20.942978 31588 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:20.943082 31588 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0cf5df5e54f43ebb49d5641a7f3c7e7. Latest consensus state: current_term: 1 leader_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } } }
I20260808 05:10:20.943127 31588 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:20.943254 31594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:20.943759 31594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:10:20.944092 31572 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Aug 08 05:10:20 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165820, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:20.950003 31594 catalog_manager.cc:1347] Generated new cluster ID: 9a936c81ac934b38b679443751e13d7f
I20260808 05:10:20.950067 31594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:10:20.952744 31584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:20.936741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39066 (local address 127.12.251.62:46343)
0808 05:10:20.936998 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:20.937008 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:20.937044 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:10:20.937661 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:20.937673 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:20.937742 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:20.937902 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:20.938649 (+ 747us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:20.940018 (+ 1369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:20.941138 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:20.941811 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:20.941920 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:20.946820 (+ 4900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:20.946865 (+ 45us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:20.946865 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:20.946982 (+ 117us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:20.950659 (+ 3677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:20.951107 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:20.951110 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:20.951110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:20.951209 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:20.951420 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:20.951420 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:20.951421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:20.951728 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:20.951862 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:20.952382 (+ 520us) server_negotiation.cc:299] Negotiation successful
0808 05:10:20.952531 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210,"thread_start_us":76,"threads_started":1}
I20260808 05:10:20.957326 31611 mvcc.cc:205] Tried to move back new op lower bound from 7316135202602590208 to 7316135202581233664. Current Snapshot: MvccSnapshot[applied={T|T < 7316135202602590208 or (T in {7316135202602590208})}]
I20260808 05:10:20.957912 31594 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:10:20.958639 31594 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:10:20.973589 31594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Generated new TSK 0
I20260808 05:10:20.973866 31594 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:10:21.681298 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:46343
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:21.778105 31648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:21.778299 31648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:21.778330 31648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:21.779429 31648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:21.779476 31648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:21.779510 31648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:10:21.780922 31648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.251.20:37523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:21.781144 31648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:21.781394 31648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:21.786062 31658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:21.786293 31655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:21.786370 31656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:21.786537 31648 server_base.cc:1034] running on GCE node
I20260808 05:10:21.786716 31648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:21.786929 31648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:21.788069 31648 hybrid_clock.cc:648] HybridClock initialized: now 1786165821788054 us; error 31 us; skew 500 ppm
Aug 08 05:10:21 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165821, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:21.793658 31648 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:10:21.794217 31648 webserver.cc:460] Webserver started at http://127.12.251.1:39729/ using document root <none> and password file <none>
I20260808 05:10:21.794500 31648 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:21.794567 31648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:21.794701 31648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:10:21 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165821, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:21.809850 31648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "ac4cc80875bd4040bedb86baa2096c1d"
format_stamp: "Formatted at 2026-08-08 05:10:21 on dist-test-slave-bndk"
server_key: "991ba1598d97f5ad8cb7ee407d16f2c8"
server_key_iv: "84396a94f7d6b9bd1b778cf48527c45d"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:21.810339 31648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "ac4cc80875bd4040bedb86baa2096c1d"
format_stamp: "Formatted at 2026-08-08 05:10:21 on dist-test-slave-bndk"
server_key: "991ba1598d97f5ad8cb7ee407d16f2c8"
server_key_iv: "84396a94f7d6b9bd1b778cf48527c45d"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:21.812785 31648 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s
I20260808 05:10:21.826028 31666 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:21.826483 31648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:21.826674 31648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "ac4cc80875bd4040bedb86baa2096c1d"
format_stamp: "Formatted at 2026-08-08 05:10:21 on dist-test-slave-bndk"
server_key: "991ba1598d97f5ad8cb7ee407d16f2c8"
server_key_iv: "84396a94f7d6b9bd1b778cf48527c45d"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:21.826865 31648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:21.866900 31648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:21.869658 31648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:21.869889 31648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:21.870219 31648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:21.870685 31648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:21.870783 31648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:21.870885 31648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:21.870958 31648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:21.878129 31648 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33877
I20260808 05:10:21.878671 31648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:10:21.880462 31822 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33877 every 8 connection(s)
I20260808 05:10:21.885488 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 31648
I20260808 05:10:21.885591 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:10:21.885753 13292 external_mini_cluster.cc:1428] Setting key b3318b73a7bddf87a69dc46a573cd8e2
Aug 08 05:10:21 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165821, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:21.898494 31827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:21.881619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:46343 (local address 127.12.251.1:53967)
0808 05:10:21.885319 (+ 3700us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:21.885374 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:21.886065 (+ 691us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:21.888760 (+ 2695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:21.888765 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:21.889016 (+ 251us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:21.889345 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:21.889352 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:21.890288 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:21.890289 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:21.891575 (+ 1286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:21.891579 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:21.892135 (+ 556us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:21.892136 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:21.892276 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:21.892871 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:21.892882 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:21.894586 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:21.896653 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:21.896661 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:21.896664 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:21.896987 (+ 323us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:21.897249 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:21.897250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:21.897250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:21.897400 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:21.897742 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:21.897750 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:21.897943 (+ 193us) client_negotiation.cc:769] Sending connection context
0808 05:10:21.898055 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 05:10:21.898222 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3645,"thread_start_us":77,"threads_started":1}
I20260808 05:10:21.899015 31826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:21.881377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:53967 (local address 127.12.251.62:46343)
0808 05:10:21.881895 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:21.881898 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:21.886205 (+ 4307us) server_negotiation.cc:407] Connection header received
0808 05:10:21.886228 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:21.886229 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:21.886241 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:21.886301 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:21.889436 (+ 3135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:21.890179 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:21.891675 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:21.891993 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:21.892053 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:21.894701 (+ 2648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:21.894703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:21.894704 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:21.894711 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:21.896548 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:21.897080 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:21.897081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:21.897082 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:21.897153 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:21.897490 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:21.897491 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:21.897492 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:21.897644 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:21.897710 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:21.898821 (+ 1111us) server_negotiation.cc:299] Negotiation successful
0808 05:10:21.898917 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":487,"thread_start_us":99,"threads_started":1}
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
I20260808 05:10:21.899669 31823 heartbeater.cc:347] Connected to a master server at 127.12.251.62:46343
I20260808 05:10:21.899784 31823 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:21.900002 31823 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:21.900596 31521 ts_manager.cc:194] Registered new tserver with Master: ac4cc80875bd4040bedb86baa2096c1d (127.12.251.1:33877)
I20260808 05:10:21.901522 31521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:53967
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:10:21.920506 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:46343
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260808 05:10:22.036234 31834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:22.036464 31834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:22.036500 31834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:22.037689 31834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:22.037731 31834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:22.037767 31834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:10:22.039482 31834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.251.20:37523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:22.039914 31834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:22.040218 31834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:22.047160 31844 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.047325 31834 server_base.cc:1034] running on GCE node
W20260808 05:10:22.047363 31843 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:22.049288 31846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.049530 31834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:22.049753 31834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:22.050915 31834 hybrid_clock.cc:648] HybridClock initialized: now 1786165822050892 us; error 30 us; skew 500 ppm
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:22.054188 31834 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:10:22.054860 31834 webserver.cc:460] Webserver started at http://127.12.251.2:37379/ using document root <none> and password file <none>
I20260808 05:10:22.055110 31834 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:22.055171 31834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:22.055357 31834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:22.068986 31834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "46f7d9e69210495d9bce8327dad382b7"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "95db34d29567a945c5d307654b97a4d0"
server_key_iv: "52ec5961257e67b25633a94873db656b"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.069430 31834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "46f7d9e69210495d9bce8327dad382b7"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "95db34d29567a945c5d307654b97a4d0"
server_key_iv: "52ec5961257e67b25633a94873db656b"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.071161 31834 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s
I20260808 05:10:22.082300 31861 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.082571 31834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:10:22.082666 31834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "46f7d9e69210495d9bce8327dad382b7"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "95db34d29567a945c5d307654b97a4d0"
server_key_iv: "52ec5961257e67b25633a94873db656b"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.082749 31834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:22.102761 31834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:22.105114 31834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:22.105348 31834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:22.105748 31834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:22.106189 31834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:22.106276 31834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.106344 31834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:22.106400 31834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.117987 31834 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:35709
I20260808 05:10:22.118433 31834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:10:22.119828 32030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:35709 every 8 connection(s)
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:22.127642 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 31834
I20260808 05:10:22.127753 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:10:22.127969 13292 external_mini_cluster.cc:1428] Setting key bff11ef8bf4d836feff92d4f61bd8efa
I20260808 05:10:22.132422 31826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:22.120807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44277 (local address 127.12.251.62:46343)
0808 05:10:22.120857 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:22.120860 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:22.121065 (+ 205us) server_negotiation.cc:407] Connection header received
0808 05:10:22.121832 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:22.121834 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:22.121850 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:22.121881 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:22.122721 (+ 840us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.123502 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.125021 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.125338 (+ 317us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.125386 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:22.128239 (+ 2853us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:22.128241 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:22.128242 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:22.128250 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:22.130548 (+ 2298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:22.131162 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:22.131164 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:22.131164 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:22.131233 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:22.131547 (+ 314us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:22.131548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:22.131548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:22.131682 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:22.131724 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:22.132193 (+ 469us) server_negotiation.cc:299] Negotiation successful
0808 05:10:22.132297 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:10:22.133425 32033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:22.120503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:46343 (local address 127.12.251.2:44277)
0808 05:10:22.120931 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:22.120979 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:22.121688 (+ 709us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:22.122082 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:22.122086 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:22.122327 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:22.122605 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:22.122612 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.123620 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.123621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:22.124905 (+ 1284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:22.124909 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.125496 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.125497 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:22.125638 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:22.126225 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:22.126236 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:22.128120 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:22.130650 (+ 2530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:22.130659 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:22.130662 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:22.131070 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:22.131325 (+ 255us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:22.131325 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:22.131325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:22.131476 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:22.131769 (+ 293us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:22.131775 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:22.131962 (+ 187us) client_negotiation.cc:769] Sending connection context
0808 05:10:22.132948 (+ 986us) client_negotiation.cc:240] Negotiation successful
0808 05:10:22.133139 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":89,"threads_started":1}
I20260808 05:10:22.134132 32031 heartbeater.cc:347] Connected to a master server at 127.12.251.62:46343
I20260808 05:10:22.134290 32031 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:22.134567 32031 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:22.134999 31521 ts_manager.cc:194] Registered new tserver with Master: 46f7d9e69210495d9bce8327dad382b7 (127.12.251.2:35709)
I20260808 05:10:22.135470 31521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:44277
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:10:22.166536 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:46343
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:22.264609 32038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:22.264814 32038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:22.264844 32038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:22.265993 32038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:22.266036 32038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:22.266068 32038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:10:22.267787 32038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.251.20:37523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:22.268028 32038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:22.268263 32038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:22.275058 32052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:22.277026 32049 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.277366 32038 server_base.cc:1034] running on GCE node
W20260808 05:10:22.277575 32045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.277825 32038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:22.278090 32038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:22.279317 32038 hybrid_clock.cc:648] HybridClock initialized: now 1786165822279293 us; error 47 us; skew 500 ppm
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:22.282840 32038 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:10:22.283272 32038 webserver.cc:460] Webserver started at http://127.12.251.3:44789/ using document root <none> and password file <none>
I20260808 05:10:22.283509 32038 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:22.283556 32038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:22.283648 32038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:22.309374 32038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "2e9a40ee8d034b29b0798f489e616077"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "f75efb40a9b226c0eb4fd9c7704ef2b6"
server_key_iv: "0339577bd4301f42660e4793ede72f19"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.309851 32038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "2e9a40ee8d034b29b0798f489e616077"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "f75efb40a9b226c0eb4fd9c7704ef2b6"
server_key_iv: "0339577bd4301f42660e4793ede72f19"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.311767 32038 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260808 05:10:22.332952 32064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.333159 32038 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260808 05:10:22.333314 32038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "2e9a40ee8d034b29b0798f489e616077"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "f75efb40a9b226c0eb4fd9c7704ef2b6"
server_key_iv: "0339577bd4301f42660e4793ede72f19"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.333429 32038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:22.375108 32038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:22.377547 32038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:22.377702 32038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:22.377954 32038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:22.378306 32038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:22.378345 32038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.378378 32038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:22.378417 32038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.387645 32038 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:38907
I20260808 05:10:22.388198 32038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:10:22.389791 32235 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:38907 every 8 connection(s)
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:22.394990 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 32038
I20260808 05:10:22.395087 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:10:22.395288 13292 external_mini_cluster.cc:1428] Setting key dd74d16a83980ceac165f3ed5a64d89c
I20260808 05:10:22.398440 31826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:22.389327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:34035 (local address 127.12.251.62:46343)
0808 05:10:22.389392 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:22.389395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:22.389744 (+ 349us) server_negotiation.cc:407] Connection header received
0808 05:10:22.390389 (+ 645us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:22.390390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:22.390404 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:22.390453 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:22.391032 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.391657 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.392862 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.393077 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.393133 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:22.395298 (+ 2165us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:22.395300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:22.395300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:22.395309 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:22.397108 (+ 1799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:22.397528 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:22.397529 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:22.397530 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:22.397585 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:22.397814 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:22.397815 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:22.397816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:22.397937 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:22.397994 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:22.398265 (+ 271us) server_negotiation.cc:299] Negotiation successful
0808 05:10:22.398349 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:10:22.398608 32240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:22.389441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:46343 (local address 127.12.251.3:34035)
0808 05:10:22.389608 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:22.389653 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:22.390281 (+ 628us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:22.390537 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:22.390542 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:22.390727 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:22.390944 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:22.390948 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.391738 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.391739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:22.392778 (+ 1039us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:22.392782 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.393162 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.393164 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:22.393314 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:22.393801 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:22.393810 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:22.395186 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:22.397193 (+ 2007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:22.397200 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:22.397202 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:22.397460 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:22.397640 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:22.397641 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:22.397641 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:22.397748 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:22.397993 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:22.398001 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:22.398134 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 05:10:22.398219 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:10:22.398369 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":80,"threads_started":1}
I20260808 05:10:22.399178 32236 heartbeater.cc:347] Connected to a master server at 127.12.251.62:46343
I20260808 05:10:22.399277 32236 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:22.399513 32236 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:22.399885 31521 ts_manager.cc:194] Registered new tserver with Master: 2e9a40ee8d034b29b0798f489e616077 (127.12.251.3:38907)
I20260808 05:10:22.400246 31521 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:34035
I20260808 05:10:22.406870 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:10:22.407534 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 31648
I20260808 05:10:22.415071 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 31834
I20260808 05:10:22.431677 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 32038
I20260808 05:10:22.445991 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 31474
I20260808 05:10:22.459787 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:46343
--webserver_interface=127.12.251.62
--webserver_port=42431
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:46343
--ranger_config_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:22.540999 32242 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:22.541198 32242 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:22.541239 32242 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:22.542361 32242 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:22.542403 32242 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:22.542416 32242 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:22.542428 32242 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:22.542447 32242 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:22.544034 32242 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:46343
--ranger_config_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:46343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=42431
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32242
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:22.544260 32242 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:22.544466 32242 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:22.549031 32249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:22.549036 32248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:22.549034 32251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.549067 32242 server_base.cc:1034] running on GCE node
I20260808 05:10:22.549530 32242 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:22.549798 32242 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:22.550966 32242 hybrid_clock.cc:648] HybridClock initialized: now 1786165822550947 us; error 30 us; skew 500 ppm
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:22.553409 32242 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:22.553835 32242 webserver.cc:460] Webserver started at http://127.12.251.62:42431/ using document root <none> and password file <none>
I20260808 05:10:22.554037 32242 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:22.554095 32242 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:22.621889 32242 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:22.622604 32261 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.622776 32242 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:10:22.622874 32242 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7"
format_stamp: "Formatted at 2026-08-08 05:10:20 on dist-test-slave-bndk"
server_key: "ff5ff5d1c6c77b978a3d61e3c41be988"
server_key_iv: "e0fcfdd58c49fef530f1c022107aa6cc"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.623253 32242 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:22.635399 32242 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:22.637146 32242 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:22.637305 32242 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:22.641058 32242 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:46343
I20260808 05:10:22.641113 32345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:46343 every 8 connection(s)
I20260808 05:10:22.641481 32242 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:22.642927 32346 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:10:22.643536 32346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Bootstrap starting.
I20260808 05:10:22.645532 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 32242
I20260808 05:10:22.645771 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:33877
--local_ip_for_outbound_sockets=127.12.251.1
--tserver_master_addrs=127.12.251.62:46343
--webserver_port=39729
--webserver_interface=127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:22.652544 32346 log.cc:824] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:22.654783 32346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:10:22.655089 32346 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Bootstrap complete.
I20260808 05:10:22.658411 32346 raft_consensus.cc:348] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:22.658746 32346 raft_consensus.cc:729] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d0cf5df5e54f43ebb49d5641a7f3c7e7, State: Initialized, Role: FOLLOWER
I20260808 05:10:22.658912 32346 consensus_queue.cc:260] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:22.658975 32346 raft_consensus.cc:388] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:10:22.659019 32346 raft_consensus.cc:482] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:10:22.659063 32346 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:10:22.660336 32346 raft_consensus.cc:504] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:22.660456 32346 leader_election.cc:302] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d0cf5df5e54f43ebb49d5641a7f3c7e7; no voters:
I20260808 05:10:22.660617 32346 leader_election.cc:288] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:10:22.660676 32352 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:10:22.660868 32346 sys_catalog.cc:564] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:22.660876 32352 raft_consensus.cc:686] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [term 2 LEADER]: Becoming Leader. State: Replica: d0cf5df5e54f43ebb49d5641a7f3c7e7, State: Running, Role: LEADER
I20260808 05:10:22.661100 32352 consensus_queue.cc:237] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } }
I20260808 05:10:22.661412 32353 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } } }
I20260808 05:10:22.661780 32353 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:22.661942 32354 sys_catalog.cc:455] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d0cf5df5e54f43ebb49d5641a7f3c7e7. Latest consensus state: current_term: 2 leader_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d0cf5df5e54f43ebb49d5641a7f3c7e7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46343 } } }
I20260808 05:10:22.662022 32373 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:22.662077 32354 sys_catalog.cc:458] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:22.662397 32346 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260808 05:10:22.662599 32373 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:10:22.662784 32373 catalog_manager.cc:1259] Loaded cluster ID: 9a936c81ac934b38b679443751e13d7f
I20260808 05:10:22.662868 32373 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:10:22.667706 32373 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:10:22.668054 32373 catalog_manager.cc:5879] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Loaded TSK: 0
I20260808 05:10:22.668426 32373 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:10:22.763070 32348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:22.763428 32348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:22.763521 32348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:22.765239 32348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:22.765339 32348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:22.765417 32348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:10:22.767529 32348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:33877
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=39729
--tserver_master_addrs=127.12.251.62:46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:22.767976 32348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:22.768266 32348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:22.775044 32405 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:22.775478 32408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.775722 32348 server_base.cc:1034] running on GCE node
W20260808 05:10:22.775770 32406 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.776140 32348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:22.776418 32348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:22.777590 32348 hybrid_clock.cc:648] HybridClock initialized: now 1786165822777560 us; error 42 us; skew 500 ppm
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:22.780799 32348 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:10:22.781363 32348 webserver.cc:460] Webserver started at http://127.12.251.1:39729/ using document root <none> and password file <none>
I20260808 05:10:22.781641 32348 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:22.781792 32348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:22.809393 32348 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s
I20260808 05:10:22.810448 32426 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.810639 32348 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:22.810740 32348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "ac4cc80875bd4040bedb86baa2096c1d"
format_stamp: "Formatted at 2026-08-08 05:10:21 on dist-test-slave-bndk"
server_key: "991ba1598d97f5ad8cb7ee407d16f2c8"
server_key_iv: "84396a94f7d6b9bd1b778cf48527c45d"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:22.811125 32348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:22.833454 32348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:22.835274 32348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:22.835413 32348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:22.835637 32348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:22.835937 32348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:22.835971 32348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.836000 32348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:22.836025 32348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:22.842998 32348 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33877
I20260808 05:10:22.843492 32348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:10:22.844710 32595 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33877 every 8 connection(s)
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:22.853425 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 32348
I20260808 05:10:22.853725 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:35709
--local_ip_for_outbound_sockets=127.12.251.2
--tserver_master_addrs=127.12.251.62:46343
--webserver_port=37379
--webserver_interface=127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:22.856109 32601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:22.844300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:46343 (local address 127.12.251.1:39949)
0808 05:10:22.845179 (+ 879us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:22.845246 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:22.845912 (+ 666us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:22.846610 (+ 698us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:22.846614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:22.846844 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:22.847124 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:22.847130 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.848521 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.848521 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:22.849389 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:22.849392 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.850040 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.850041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:22.850166 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:22.850688 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:22.850698 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:22.852210 (+ 1512us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:22.854181 (+ 1971us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:22.854187 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:22.854190 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:22.854498 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:22.854793 (+ 295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:22.854794 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:22.854794 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:22.854932 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:22.855442 (+ 510us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:22.855449 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:22.855616 (+ 167us) client_negotiation.cc:769] Sending connection context
0808 05:10:22.855727 (+ 111us) client_negotiation.cc:240] Negotiation successful
0808 05:10:22.855881 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":834,"thread_start_us":87,"threads_started":1}
I20260808 05:10:22.856750 32603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:22.844365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:39949 (local address 127.12.251.62:46343)
0808 05:10:22.845085 (+ 720us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:22.845096 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:22.845355 (+ 259us) server_negotiation.cc:407] Connection header received
0808 05:10:22.846208 (+ 853us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:22.846217 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:22.846279 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:22.846394 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:22.847265 (+ 871us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.848413 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.849521 (+ 1108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:22.849926 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:22.850024 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:22.852310 (+ 2286us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:22.852315 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:22.852315 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:22.852328 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:22.854084 (+ 1756us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:22.854594 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:22.854598 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:22.854598 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:22.854713 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:22.855013 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:22.855014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:22.855015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:22.855326 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:22.855411 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:22.856407 (+ 996us) server_negotiation.cc:299] Negotiation successful
0808 05:10:22.856546 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":86,"threads_started":1}
I20260808 05:10:22.857390 32597 heartbeater.cc:347] Connected to a master server at 127.12.251.62:46343
I20260808 05:10:22.857508 32597 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:22.857754 32597 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
W20260808 05:10:22.858630 32597 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:46343 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:10:22.858698 32597 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:22.858783 32597 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:22.859089 32597 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:22.859164 32597 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
W20260808 05:10:22.859498 32597 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:10:22.963299 32604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:22.963573 32604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:22.963608 32604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:22.965287 32604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:22.965389 32604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:22.965448 32604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:10:22.967594 32604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:35709
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=37379
--tserver_master_addrs=127.12.251.62:46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:22.967854 32604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:22.968143 32604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:22.974262 32612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:22.974339 32616 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:22.974248 32614 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:22.974489 32604 server_base.cc:1034] running on GCE node
I20260808 05:10:22.974743 32604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:22.974951 32604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:22.976110 32604 hybrid_clock.cc:648] HybridClock initialized: now 1786165822976095 us; error 33 us; skew 500 ppm
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:22.979058 32604 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:10:22.979578 32604 webserver.cc:460] Webserver started at http://127.12.251.2:37379/ using document root <none> and password file <none>
I20260808 05:10:22.979840 32604 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:22.979919 32604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:10:22 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:23.000674 32604 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:23.001585 32629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:23.001793 32604 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260808 05:10:23.001873 32604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "46f7d9e69210495d9bce8327dad382b7"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "95db34d29567a945c5d307654b97a4d0"
server_key_iv: "52ec5961257e67b25633a94873db656b"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:23.002255 32604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:23.015753 32604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:23.018131 32604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:23.018289 32604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:23.018538 32604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:23.018896 32604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:23.018939 32604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:23.018960 32604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:23.018971 32604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:23.026011 32604 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:35709
I20260808 05:10:23.026147 327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:35709 every 8 connection(s)
I20260808 05:10:23.026422 32604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:10:23 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165822, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:23.033388 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 32604
I20260808 05:10:23.033653 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.251.20:37523/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:38907
--local_ip_for_outbound_sockets=127.12.251.3
--tserver_master_addrs=127.12.251.62:46343
--webserver_port=44789
--webserver_interface=127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:43241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:23.039829 32603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:23.027187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:46213 (local address 127.12.251.62:46343)
0808 05:10:23.027265 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:23.027268 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:23.027492 (+ 224us) server_negotiation.cc:407] Connection header received
0808 05:10:23.028118 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:23.028119 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:23.028129 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:23.028173 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:23.028870 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.029391 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.030848 (+ 1457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.031176 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.031249 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:23.036407 (+ 5158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:23.036409 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:23.036409 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:23.036418 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:23.038206 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:23.038716 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:23.038718 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:23.038718 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:23.038782 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:23.039073 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:23.039074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:23.039075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:23.039214 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:23.039285 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:23.039640 (+ 355us) server_negotiation.cc:299] Negotiation successful
0808 05:10:23.039729 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:10:23.040067 331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:23.027169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:46343 (local address 127.12.251.2:46213)
0808 05:10:23.027340 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:23.027389 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:23.028016 (+ 627us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:23.028254 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:23.028259 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:23.028496 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:23.028785 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:23.028792 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.029482 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.029483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:23.030739 (+ 1256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:23.030742 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.031290 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.031304 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:23.031457 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:23.032024 (+ 567us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:23.032033 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:23.036296 (+ 4263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:23.038297 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:23.038305 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:23.038307 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:23.038633 (+ 326us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:23.038855 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:23.038856 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:23.038856 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:23.039003 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:23.039293 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:23.039300 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:23.039480 (+ 180us) client_negotiation.cc:769] Sending connection context
0808 05:10:23.039605 (+ 125us) client_negotiation.cc:240] Negotiation successful
0808 05:10:23.039776 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260808 05:10:23.040711 329 heartbeater.cc:347] Connected to a master server at 127.12.251.62:46343
I20260808 05:10:23.040827 329 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:23.041045 329 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
W20260808 05:10:23.041795 329 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:46343 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:10:23.041872 329 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:23.041990 329 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:23.042340 329 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:23.042477 329 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
W20260808 05:10:23.042863 329 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:10:23.131510 332 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:23.131708 332 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:23.131738 332 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:23.132841 332 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:23.132880 332 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:23.132913 332 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:10:23.134353 332 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.251.20:37523/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:38907
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=44789
--tserver_master_addrs=127.12.251.62:46343
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.332
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:23.134577 332 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:23.134829 332 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:23.139606 338 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:23.139678 341 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:23.139912 347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:23.139997 332 server_base.cc:1034] running on GCE node
I20260808 05:10:23.140309 332 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:23.140621 332 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:23.147974 332 hybrid_clock.cc:648] HybridClock initialized: now 1786165823145695 us; error 2286 us; skew 500 ppm
Aug 08 05:10:23 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165823, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:23.151038 332 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:10:23.151600 332 webserver.cc:460] Webserver started at http://127.12.251.3:44789/ using document root <none> and password file <none>
I20260808 05:10:23.151882 332 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:23.151961 332 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 08 05:10:23 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165823, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:23.176730 332 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:23.177795 358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:23.178007 332 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:23.178107 332 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "2e9a40ee8d034b29b0798f489e616077"
format_stamp: "Formatted at 2026-08-08 05:10:22 on dist-test-slave-bndk"
server_key: "f75efb40a9b226c0eb4fd9c7704ef2b6"
server_key_iv: "0339577bd4301f42660e4793ede72f19"
server_key_version: "kuduclusterkey@0"
I20260808 05:10:23.178587 332 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:23.199460 332 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:23.201354 332 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:23.201503 332 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:23.201713 332 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:23.202072 332 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:23.202160 332 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:23.202222 332 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:23.202265 332 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:23.209167 332 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:38907
I20260808 05:10:23.209699 332 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:10:23.209939 521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:38907 every 8 connection(s)
I20260808 05:10:23.210414 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 332
Aug 08 05:10:23 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165823, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:23.219875 527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:23.210816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39082 (local address 127.12.251.62:46343)
0808 05:10:23.212908 (+ 2092us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:23.212910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:23.212917 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:10:23.212937 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:23.212938 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:23.212949 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:23.213017 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:23.213855 (+ 838us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.214552 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.215458 (+ 906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.215674 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.215730 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:23.217013 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:23.217014 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:23.217015 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:23.217022 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:23.218824 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:23.219136 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:23.219138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:23.219138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:23.219196 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:23.219366 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:23.219367 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:23.219367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:23.219476 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:23.219647 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:23.219682 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 05:10:23.219758 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2073,"thread_start_us":56,"threads_started":1}
I20260808 05:10:23.221009 32603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:23.210733 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:43355 (local address 127.12.251.62:46343)
0808 05:10:23.211000 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:23.211002 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:23.211244 (+ 242us) server_negotiation.cc:407] Connection header received
0808 05:10:23.211897 (+ 653us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:23.211898 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:23.211909 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:23.211949 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:23.212654 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.213247 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.214547 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.214832 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.214909 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:23.217636 (+ 2727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:23.217638 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:23.217638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:23.217645 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:23.219413 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:23.219928 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:23.219929 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:23.219929 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:23.219990 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:23.220382 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:23.220383 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:23.220383 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:23.220514 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:23.220577 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:23.220889 (+ 312us) server_negotiation.cc:299] Negotiation successful
0808 05:10:23.220952 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":229}
I20260808 05:10:23.221334 526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:23.210748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:46343 (local address 127.12.251.3:43355)
0808 05:10:23.211054 (+ 306us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:23.211135 (+ 81us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:23.211785 (+ 650us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:23.212041 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:23.212046 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:23.212287 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:23.212568 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:23.212575 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.213333 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.213334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:23.214415 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:23.214418 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:23.214944 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:23.214945 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:23.215083 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:23.215927 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:23.215937 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:23.217527 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:23.219521 (+ 1994us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:23.219528 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:23.219530 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:23.219832 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:23.220162 (+ 330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:23.220163 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:23.220163 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:23.220306 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:23.220585 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:23.220591 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:23.220754 (+ 163us) client_negotiation.cc:769] Sending connection context
0808 05:10:23.220864 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:10:23.221018 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":89,"threads_started":1}
I20260808 05:10:23.221863 523 heartbeater.cc:347] Connected to a master server at 127.12.251.62:46343
I20260808 05:10:23.221971 523 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:23.222148 523 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
W20260808 05:10:23.222898 523 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:46343 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260808 05:10:23.222963 523 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:23.223034 523 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:23.223416 523 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:23.223483 523 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
W20260808 05:10:23.223802 523 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 08 05:10:23 dist-test-slave-bndk krb5kdc[30787](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786165823, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:23.859721 32597 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:23.859882 32597 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:23.860328 32293 ts_manager.cc:194] Registered new tserver with Master: ac4cc80875bd4040bedb86baa2096c1d (127.12.251.1:33877)
I20260808 05:10:23.861505 32293 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:39949
I20260808 05:10:24.043077 329 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:24.043236 329 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:24.043534 32293 ts_manager.cc:194] Registered new tserver with Master: 46f7d9e69210495d9bce8327dad382b7 (127.12.251.2:35709)
I20260808 05:10:24.044080 32293 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:46213
Aug 08 05:10:24 dist-test-slave-bndk krb5kdc[30787](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165823, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for HTTP/127.12.251.20@KRBTEST.COM
I20260808 05:10:24.223992 523 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:24.224161 523 heartbeater.cc:511] Master 127.12.251.62:46343 requested a full tablet report, sending...
I20260808 05:10:24.224540 32291 ts_manager.cc:194] Registered new tserver with Master: 2e9a40ee8d034b29b0798f489e616077 (127.12.251.3:38907)
I20260808 05:10:24.225064 32291 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:43355
I20260808 05:10:24.230110 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:10:24.239356 555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.231176 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39094 (local address 127.12.251.62:46343)
0808 05:10:24.231609 (+ 433us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:24.231611 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:24.231617 (+ 6us) server_negotiation.cc:407] Connection header received
0808 05:10:24.231639 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:24.231639 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:24.231650 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:24.232375 (+ 725us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:24.232411 (+ 36us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.233195 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.234270 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.234591 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.236072 (+ 1481us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.236124 (+ 52us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:24.236125 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:24.236126 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:24.236130 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:24.237870 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:24.238257 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:24.238258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:24.238258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:24.238314 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:24.238512 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:24.238513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:24.238513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:24.238641 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:24.239128 (+ 487us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:24.239169 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 05:10:24.239249 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":65,"threads_started":1}
I20260808 05:10:24.241668 32291 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39094:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:10:24.243834 32291 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:10:24.252666 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.247163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:35709 (local address 127.0.0.1:45636)
0808 05:10:24.248171 (+ 1008us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:24.248179 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:24.248210 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:24.248579 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:24.248583 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:24.248585 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:24.248666 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.248668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.249965 (+ 1297us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.249966 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.251269 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.251272 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.252346 (+ 1074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.252347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.252437 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.252464 (+ 27us) client_negotiation.cc:769] Sending connection context
0808 05:10:24.252530 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 05:10:24.252582 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":995,"thread_start_us":90,"threads_started":1}
I20260808 05:10:24.253239 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.247277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45636 (local address 127.12.251.2:35709)
0808 05:10:24.248302 (+ 1025us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:24.248307 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:24.248316 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:10:24.248352 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:24.248355 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:24.248371 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:24.248437 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:24.248744 (+ 307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.249870 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.251391 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.252185 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.252252 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.252311 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:24.253096 (+ 785us) server_negotiation.cc:299] Negotiation successful
0808 05:10:24.253137 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":992,"thread_start_us":85,"threads_started":1}
I20260808 05:10:24.254150 32677 tablet_service.cc:1467] Processing CreateTablet for tablet e9902e851c854bde9c2d997e388a2ebb (DEFAULT_TABLE table=test-table [id=7af182c740d74982968bb88fed9043a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:24.254582 32677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9902e851c854bde9c2d997e388a2ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:24.259008 561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.247418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33877 (local address 127.0.0.1:58946)
0808 05:10:24.252974 (+ 5556us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:24.252985 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:24.253025 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:24.254209 (+ 1184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:24.254209 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:24.254211 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:24.254236 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.254237 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.255467 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.255468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.256555 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.256557 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.258778 (+ 2221us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.258779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.258844 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.258848 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:24.258893 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:10:24.258934 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5544,"thread_start_us":93,"threads_started":1}
I20260808 05:10:24.261682 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.247157 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:38907 (local address 127.0.0.1:58558)
0808 05:10:24.247968 (+ 811us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:24.248014 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:24.248078 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:24.253812 (+ 5734us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:24.253813 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:24.253815 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:24.253856 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.253857 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.259192 (+ 5335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.259193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.260287 (+ 1094us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.260289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.261471 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.261472 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.261537 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.261542 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:10:24.261573 (+ 31us) client_negotiation.cc:240] Negotiation successful
0808 05:10:24.261610 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":774,"thread_start_us":110,"threads_started":1}
I20260808 05:10:24.262060 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.247709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58558 (local address 127.12.251.3:38907)
0808 05:10:24.253567 (+ 5858us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:24.253572 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:24.253583 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:10:24.253616 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:24.253618 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:24.253633 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:24.253712 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:24.256658 (+ 2946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.257767 (+ 1109us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.260431 (+ 2664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.261179 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.261838 (+ 659us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.261911 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:24.261938 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 05:10:24.261979 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5817,"thread_start_us":51,"threads_started":1}
I20260808 05:10:24.262275 567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.247531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58946 (local address 127.12.251.1:33877)
0808 05:10:24.253985 (+ 6454us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:24.253990 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:24.253999 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:10:24.254035 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:24.254037 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:24.254053 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:24.254122 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:24.254299 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.255367 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.257862 (+ 2495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.258626 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.258686 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.258744 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:24.261331 (+ 2587us) server_negotiation.cc:299] Negotiation successful
0808 05:10:24.262198 (+ 867us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6412,"thread_start_us":54,"threads_started":1}
I20260808 05:10:24.263052 408 tablet_service.cc:1467] Processing CreateTablet for tablet e9902e851c854bde9c2d997e388a2ebb (DEFAULT_TABLE table=test-table [id=7af182c740d74982968bb88fed9043a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:24.263051 32496 tablet_service.cc:1467] Processing CreateTablet for tablet e9902e851c854bde9c2d997e388a2ebb (DEFAULT_TABLE table=test-table [id=7af182c740d74982968bb88fed9043a5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:24.263412 408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9902e851c854bde9c2d997e388a2ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:24.263429 32496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9902e851c854bde9c2d997e388a2ebb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:24.267158 569 tablet_bootstrap.cc:492] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Bootstrap starting.
I20260808 05:10:24.267246 572 tablet_bootstrap.cc:492] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Bootstrap starting.
I20260808 05:10:24.267956 572 tablet_bootstrap.cc:654] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:24.267977 569 tablet_bootstrap.cc:654] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:24.268321 572 log.cc:824] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:24.268730 569 log.cc:824] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:24.269140 572 tablet_bootstrap.cc:492] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: No bootstrap required, opened a new log
I20260808 05:10:24.269212 572 ts_tablet_manager.cc:1397] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:10:24.271420 572 raft_consensus.cc:348] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.271605 572 raft_consensus.cc:374] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:24.271641 572 raft_consensus.cc:729] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2e9a40ee8d034b29b0798f489e616077, State: Initialized, Role: FOLLOWER
I20260808 05:10:24.271750 572 consensus_queue.cc:260] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.271991 572 ts_tablet_manager.cc:1428] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:10:24.272156 523 heartbeater.cc:503] Master 127.12.251.62:46343 was elected leader, sending a full tablet report...
I20260808 05:10:24.273370 573 tablet_bootstrap.cc:492] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d: Bootstrap starting.
I20260808 05:10:24.274057 569 tablet_bootstrap.cc:492] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: No bootstrap required, opened a new log
I20260808 05:10:24.274140 569 ts_tablet_manager.cc:1397] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.000s
I20260808 05:10:24.276870 573 tablet_bootstrap.cc:654] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:24.277014 569 raft_consensus.cc:348] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.277176 573 log.cc:824] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:24.277248 569 raft_consensus.cc:374] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:24.277369 569 raft_consensus.cc:729] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46f7d9e69210495d9bce8327dad382b7, State: Initialized, Role: FOLLOWER
I20260808 05:10:24.277580 569 consensus_queue.cc:260] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.277940 569 ts_tablet_manager.cc:1428] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 05:10:24.278100 329 heartbeater.cc:503] Master 127.12.251.62:46343 was elected leader, sending a full tablet report...
I20260808 05:10:24.279366 573 tablet_bootstrap.cc:492] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d: No bootstrap required, opened a new log
I20260808 05:10:24.279493 573 ts_tablet_manager.cc:1397] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260808 05:10:24.282414 573 raft_consensus.cc:348] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.282652 573 raft_consensus.cc:374] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:24.282745 573 raft_consensus.cc:729] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac4cc80875bd4040bedb86baa2096c1d, State: Initialized, Role: FOLLOWER
I20260808 05:10:24.282967 573 consensus_queue.cc:260] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.283360 573 ts_tablet_manager.cc:1428] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260808 05:10:24.283528 32597 heartbeater.cc:503] Master 127.12.251.62:46343 was elected leader, sending a full tablet report...
I20260808 05:10:24.293372 580 raft_consensus.cc:482] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:24.293606 580 raft_consensus.cc:504] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.294924 580 leader_election.cc:288] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2e9a40ee8d034b29b0798f489e616077 (127.12.251.3:38907), 46f7d9e69210495d9bce8327dad382b7 (127.12.251.2:35709)
I20260808 05:10:24.304399 568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.294436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:32849 (local address 127.12.251.3:38907)
0808 05:10:24.294485 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:24.294487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:24.298388 (+ 3901us) server_negotiation.cc:407] Connection header received
0808 05:10:24.298494 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:24.298495 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:24.298504 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:24.298533 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:24.298742 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.299472 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.303433 (+ 3961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.303966 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.304019 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.304029 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:24.304264 (+ 235us) server_negotiation.cc:299] Negotiation successful
0808 05:10:24.304310 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:10:24.304961 585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.294209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:38907 (local address 127.12.251.1:32849)
0808 05:10:24.298309 (+ 4100us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:24.298320 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:24.298421 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:24.298596 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:24.298597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:24.298599 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:24.298676 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.298677 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.299578 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.299579 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.300827 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.300831 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.304122 (+ 3291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.304122 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.304182 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.304186 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:24.304733 (+ 547us) client_negotiation.cc:240] Negotiation successful
0808 05:10:24.304815 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4080,"thread_start_us":100,"threads_started":1}
I20260808 05:10:24.305568 448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9902e851c854bde9c2d997e388a2ebb" candidate_uuid: "ac4cc80875bd4040bedb86baa2096c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e9a40ee8d034b29b0798f489e616077" is_pre_election: true
I20260808 05:10:24.305737 448 raft_consensus.cc:2454] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4cc80875bd4040bedb86baa2096c1d in term 0.
I20260808 05:10:24.306191 32430 leader_election.cc:302] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e9a40ee8d034b29b0798f489e616077, ac4cc80875bd4040bedb86baa2096c1d; no voters:
I20260808 05:10:24.306411 580 raft_consensus.cc:2781] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:10:24.306530 580 raft_consensus.cc:482] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:10:24.306612 580 raft_consensus.cc:3037] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:24.307699 580 raft_consensus.cc:504] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.308048 448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9902e851c854bde9c2d997e388a2ebb" candidate_uuid: "ac4cc80875bd4040bedb86baa2096c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2e9a40ee8d034b29b0798f489e616077"
I20260808 05:10:24.308128 448 raft_consensus.cc:3037] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:24.309052 448 raft_consensus.cc:2454] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4cc80875bd4040bedb86baa2096c1d in term 1.
I20260808 05:10:24.309324 32430 leader_election.cc:302] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2e9a40ee8d034b29b0798f489e616077, ac4cc80875bd4040bedb86baa2096c1d; no voters:
I20260808 05:10:24.309619 580 leader_election.cc:288] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [CANDIDATE]: Term 1 election: Requested vote from peers 2e9a40ee8d034b29b0798f489e616077 (127.12.251.3:38907), 46f7d9e69210495d9bce8327dad382b7 (127.12.251.2:35709)
I20260808 05:10:24.309713 580 raft_consensus.cc:2781] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:24.309788 580 raft_consensus.cc:686] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [term 1 LEADER]: Becoming Leader. State: Replica: ac4cc80875bd4040bedb86baa2096c1d, State: Running, Role: LEADER
I20260808 05:10:24.309908 580 consensus_queue.cc:237] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } }
I20260808 05:10:24.311244 32291 catalog_manager.cc:5495] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d reported cstate change: term changed from 0 to 1, leader changed from <none> to ac4cc80875bd4040bedb86baa2096c1d (127.12.251.1). New cstate: current_term: 1 leader_uuid: "ac4cc80875bd4040bedb86baa2096c1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac4cc80875bd4040bedb86baa2096c1d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33877 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 } health_report { overall_health: UNKNOWN } } }
I20260808 05:10:24.313033 565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.294841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:47999 (local address 127.12.251.2:35709)
0808 05:10:24.294901 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:24.294903 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:24.301036 (+ 6133us) server_negotiation.cc:407] Connection header received
0808 05:10:24.301146 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:24.301147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:24.301159 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:24.301186 (+ 27us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:24.301417 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.302131 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.311838 (+ 9707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.312406 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.312460 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.312470 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:24.312922 (+ 452us) server_negotiation.cc:299] Negotiation successful
0808 05:10:24.312967 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260808 05:10:24.313443 583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.294638 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:35709 (local address 127.12.251.1:47999)
0808 05:10:24.300976 (+ 6338us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:24.300987 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:24.301062 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:24.301273 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:24.301274 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:24.301275 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:24.301346 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.301347 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.302235 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.302236 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.303295 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:24.303298 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.312758 (+ 9460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.312758 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:24.312836 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.312840 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:24.313303 (+ 463us) client_negotiation.cc:240] Negotiation successful
0808 05:10:24.313359 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6320,"thread_start_us":85,"threads_started":1}
I20260808 05:10:24.314003 32732 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9902e851c854bde9c2d997e388a2ebb" candidate_uuid: "ac4cc80875bd4040bedb86baa2096c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f7d9e69210495d9bce8327dad382b7" is_pre_election: true
I20260808 05:10:24.314168 32732 raft_consensus.cc:2454] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ac4cc80875bd4040bedb86baa2096c1d in term 0.
I20260808 05:10:24.314287 32731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9902e851c854bde9c2d997e388a2ebb" candidate_uuid: "ac4cc80875bd4040bedb86baa2096c1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46f7d9e69210495d9bce8327dad382b7"
I20260808 05:10:24.314378 32731 raft_consensus.cc:3037] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:24.315299 32731 raft_consensus.cc:2454] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ac4cc80875bd4040bedb86baa2096c1d in term 1.
I20260808 05:10:24.330749 567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.327369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58948 (local address 127.12.251.1:33877)
0808 05:10:24.327411 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:24.327413 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:24.327420 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:10:24.327456 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:24.327457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:24.327476 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:24.327538 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:10:24.327719 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.328435 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.329578 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:24.329865 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:24.329942 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:24.330151 (+ 209us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:10:24.330298 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:10:24.330397 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:24.330654 (+ 257us) server_negotiation.cc:299] Negotiation successful
0808 05:10:24.330676 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:10:24.333101 32731 raft_consensus.cc:1261] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 1 FOLLOWER]: Refusing update from remote peer ac4cc80875bd4040bedb86baa2096c1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:24.333565 586 consensus_queue.cc:1035] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "46f7d9e69210495d9bce8327dad382b7" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:24.335958 448 raft_consensus.cc:1261] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 1 FOLLOWER]: Refusing update from remote peer ac4cc80875bd4040bedb86baa2096c1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:24.336295 586 consensus_queue.cc:1035] T e9902e851c854bde9c2d997e388a2ebb P ac4cc80875bd4040bedb86baa2096c1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "2e9a40ee8d034b29b0798f489e616077" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 38907 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:24.341096 590 mvcc.cc:205] Tried to move back new op lower bound from 7316135216465317888 to 7316135216375939072. Current Snapshot: MvccSnapshot[applied={T|T < 7316135216465317888}]
I20260808 05:10:24.341403 593 mvcc.cc:205] Tried to move back new op lower bound from 7316135216465317888 to 7316135216375939072. Current Snapshot: MvccSnapshot[applied={T|T < 7316135216465317888}]
I20260808 05:10:24.344012 591 mvcc.cc:205] Tried to move back new op lower bound from 7316135216465317888 to 7316135216375939072. Current Snapshot: MvccSnapshot[applied={T|T < 7316135216465317888}]
I20260808 05:10:24.347069 32291 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:24.347168 32291 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:39094:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:24.348140 32291 catalog_manager.cc:5782] T 00000000000000000000000000000000 P d0cf5df5e54f43ebb49d5641a7f3c7e7: Sending DeleteTablet for 3 replicas of tablet e9902e851c854bde9c2d997e388a2ebb
I20260808 05:10:24.348713 408 tablet_service.cc:1514] Processing DeleteTablet for tablet e9902e851c854bde9c2d997e388a2ebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:24 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:58558
I20260808 05:10:24.349050 32496 tablet_service.cc:1514] Processing DeleteTablet for tablet e9902e851c854bde9c2d997e388a2ebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:24 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:58946
I20260808 05:10:24.349429 32677 tablet_service.cc:1514] Processing DeleteTablet for tablet e9902e851c854bde9c2d997e388a2ebb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:24 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:45636
I20260808 05:10:24.350044 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 32348
I20260808 05:10:24.362462 601 tablet_replica.cc:330] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: stopping tablet replica
I20260808 05:10:24.367821 603 tablet_replica.cc:330] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: stopping tablet replica
I20260808 05:10:24.368117 603 raft_consensus.cc:2229] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:10:24.368326 601 raft_consensus.cc:2229] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:10:24.368641 603 raft_consensus.cc:2258] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:24.368839 601 raft_consensus.cc:2258] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:24.369668 601 ts_tablet_manager.cc:1905] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:24.370002 603 ts_tablet_manager.cc:1905] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:24.371812 603 ts_tablet_manager.cc:1918] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:24.373708 601 ts_tablet_manager.cc:1918] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:24.373845 603 log.cc:1196] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/e9902e851c854bde9c2d997e388a2ebb
I20260808 05:10:24.373972 601 log.cc:1196] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/e9902e851c854bde9c2d997e388a2ebb
I20260808 05:10:24.374372 603 ts_tablet_manager.cc:1939] T e9902e851c854bde9c2d997e388a2ebb P 46f7d9e69210495d9bce8327dad382b7: Deleting consensus metadata
I20260808 05:10:24.374698 601 ts_tablet_manager.cc:1939] T e9902e851c854bde9c2d997e388a2ebb P 2e9a40ee8d034b29b0798f489e616077: Deleting consensus metadata
I20260808 05:10:24.375218 32265 catalog_manager.cc:4841] TS 2e9a40ee8d034b29b0798f489e616077 (127.12.251.3:38907): tablet e9902e851c854bde9c2d997e388a2ebb (table test-table [id=7af182c740d74982968bb88fed9043a5]) successfully deleted
I20260808 05:10:24.375816 32263 catalog_manager.cc:4841] TS 46f7d9e69210495d9bce8327dad382b7 (127.12.251.2:35709): tablet e9902e851c854bde9c2d997e388a2ebb (table test-table [id=7af182c740d74982968bb88fed9043a5]) successfully deleted
W20260808 05:10:24.376292 32265 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:33877 (error 108)
I20260808 05:10:24.377482 562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:24.377323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33877 (local address 127.0.0.1:58956)
0808 05:10:24.377388 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:24.377445 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:33877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 05:10:24.377480 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 32604
W20260808 05:10:24.377700 32265 catalog_manager.cc:4584] TS ac4cc80875bd4040bedb86baa2096c1d (127.12.251.1:33877): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e9902e851c854bde9c2d997e388a2ebb: Network error: Client connection negotiation failed: client connection to 127.12.251.1:33877: connect: Connection refused (error 111)
I20260808 05:10:24.396783 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 332
I20260808 05:10:24.409547 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 32242
I20260808 05:10:24.421425 13292 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260808 05:10:24.765376 13292 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260808 05:10:24.765489 13292 mini_ranger.cc:66] Stopping Ranger...
I20260808 05:10:25.109477 13292 mini_ranger.cc:68] Stopped Ranger
2026-08-08 05:10:25.109 UTC [30837] LOG: received smart shutdown request
2026-08-08 05:10:25.113 UTC [30837] LOG: background worker "logical replication launcher" (PID 30850) exited with exit code 1
2026-08-08 05:10:25.113 UTC [30842] LOG: shutting down
2026-08-08 05:10:25.252 UTC [30837] LOG: database system is shut down
2026-08-08T05:10:25Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (46598 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:10:25 dist-test-slave-bndk krb5kdc[616](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:10:25 dist-test-slave-bndk krb5kdc[616](info): set up 2 sockets
Aug 08 05:10:25 dist-test-slave-bndk krb5kdc[616](info): commencing operation
krb5kdc: starting...
W20260808 05:10:26.488245 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.118s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:10:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:10:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:10:26.601994 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36853
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:36853,127.12.251.61:32911,127.12.251.60:34463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:26.682070 641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:26.682271 641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:26.682301 641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:26.683408 641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:26.683446 641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:26.683465 641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:26.683480 641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:26.683494 641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:26.684939 641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:36853,127.12.251.61:32911,127.12.251.60:34463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36853
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:26.685189 641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:26.685408 641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:26.689947 655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:26.690090 641 server_base.cc:1034] running on GCE node
W20260808 05:10:26.689989 648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:26.689985 651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:26.690404 641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:26.690683 641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:26.691821 641 hybrid_clock.cc:648] HybridClock initialized: now 1786165826691802 us; error 31 us; skew 500 ppm
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:26.694545 641 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:26.695020 641 webserver.cc:460] Webserver started at http://127.12.251.62:46881/ using document root <none> and password file <none>
I20260808 05:10:26.695227 641 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:26.695274 641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:26.695401 641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:26.696389 641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "921dc0c7149845229709b01722b124e0"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "fca56d8c7a0e37af57d9e8be9f4f4f19"
server_key_iv: "0b7b76f6e0efdbb47f676a8fc45eb491"
server_key_version: "encryptionkey@0"
I20260808 05:10:26.696722 641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "921dc0c7149845229709b01722b124e0"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "fca56d8c7a0e37af57d9e8be9f4f4f19"
server_key_iv: "0b7b76f6e0efdbb47f676a8fc45eb491"
server_key_version: "encryptionkey@0"
I20260808 05:10:26.697985 641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:10:26.698606 664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:26.698757 641 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:26.698839 641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "921dc0c7149845229709b01722b124e0"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "fca56d8c7a0e37af57d9e8be9f4f4f19"
server_key_iv: "0b7b76f6e0efdbb47f676a8fc45eb491"
server_key_version: "encryptionkey@0"
I20260808 05:10:26.698904 641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:26.711455 641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:26.713068 641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:26.713191 641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:26.717046 641 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:36853
I20260808 05:10:26.717080 736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:36853 every 8 connection(s)
I20260808 05:10:26.717423 641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:26.718220 737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:26.719726 737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:26.726401 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 641
I20260808 05:10:26.726523 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:10:26.726717 13292 external_mini_cluster.cc:1428] Setting key d68f47a650241d857df3c294b5656533
I20260808 05:10:26.728610 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.720357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36853 (local address 127.0.0.1:40488)
0808 05:10:26.720532 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.720574 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:26.721045 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:26.721344 (+ 299us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:26.721347 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:26.721612 (+ 265us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:26.721759 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.721765 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.722735 (+ 970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.722735 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.723398 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.723400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.723873 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.723874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.723946 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.724344 (+ 398us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:26.724352 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:26.725678 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:26.727235 (+ 1557us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.727242 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.727244 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.727416 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.727646 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.727647 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.727647 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.727720 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.728095 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:26.728101 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:26.728163 (+ 62us) client_negotiation.cc:769] Sending connection context
0808 05:10:26.728238 (+ 75us) client_negotiation.cc:240] Negotiation successful
0808 05:10:26.728438 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"mutex_wait_us":74,"thread_start_us":97,"threads_started":1}
I20260808 05:10:26.728615 739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.720363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40488 (local address 127.12.251.62:36853)
0808 05:10:26.720540 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:26.720549 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:26.720659 (+ 110us) server_negotiation.cc:407] Connection header received
0808 05:10:26.721191 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:26.721194 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:26.721247 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:26.721329 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:26.721851 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.722646 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.723475 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.723798 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.723895 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.725753 (+ 1858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:26.725761 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:26.725761 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:26.725768 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:26.727160 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.727508 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.727512 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.727512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.727590 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.727773 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.727774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.727774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.728033 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:26.728107 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:26.728270 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 05:10:26.728381 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260808 05:10:26.729296 737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:10:26.729617 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.729520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:37954)
0808 05:10:26.729561 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.729599 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 05:10:26.729732 665 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
I20260808 05:10:26.730103 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.730036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:37958)
0808 05:10:26.730064 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.730087 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 05:10:26.730207 737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:32911: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.251.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab.
Entry for principal kudu/127.12.251.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab.
I20260808 05:10:26.751272 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:32911
--webserver_interface=127.12.251.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab
--principal=kudu/127.12.251.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:36853,127.12.251.61:32911,127.12.251.60:34463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:26.779392 737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } attempt: 1
I20260808 05:10:26.779903 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.779770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:37970)
0808 05:10:26.779832 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.779873 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260808 05:10:26.780233 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.780153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:37972)
0808 05:10:26.780188 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.780212 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 05:10:26.780313 737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:32911: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
W20260808 05:10:26.832486 748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:26.832685 748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:26.832715 748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:26.833832 748 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:26.833871 748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:26.833890 748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:26.833906 748 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:26.833921 748 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:26.835403 748 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:36853,127.12.251.61:32911,127.12.251.60:34463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab
--principal=kudu/127.12.251.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:32911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.251.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:26.835644 748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:26.835847 748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:26.840314 761 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:26.840323 758 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:26.840332 756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:26.840559 748 server_base.cc:1034] running on GCE node
I20260808 05:10:26.840813 748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:26.841068 748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:26.842202 748 hybrid_clock.cc:648] HybridClock initialized: now 1786165826842180 us; error 41 us; skew 500 ppm
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:26.847106 748 init.cc:377] Logged in from keytab as kudu/127.12.251.61@KRBTEST.COM (short username kudu)
I20260808 05:10:26.847491 748 webserver.cc:460] Webserver started at http://127.12.251.61:33825/ using document root <none> and password file <none>
I20260808 05:10:26.847682 748 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:26.847721 748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:26.847811 748 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:26.848455 737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } attempt: 2
I20260808 05:10:26.848841 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.848707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:37980)
0808 05:10:26.848768 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.848805 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 05:10:26.848881 748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data/instance:
uuid: "84d100ea3f9446cf95cdb5558ed7c4fd"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "e33556e91a689ad69187b8fab1b7c420"
server_key_iv: "b77ee8fb550c04c96ea44a60dc0aefcb"
server_key_version: "encryptionkey@0"
I20260808 05:10:26.849184 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.849088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:37986)
0808 05:10:26.849129 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.849153 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 05:10:26.849292 748 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/wal/instance:
uuid: "84d100ea3f9446cf95cdb5558ed7c4fd"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "e33556e91a689ad69187b8fab1b7c420"
server_key_iv: "b77ee8fb550c04c96ea44a60dc0aefcb"
server_key_version: "encryptionkey@0"
W20260808 05:10:26.849301 737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:32911: Network error: Client connection negotiation failed: client connection to 127.12.251.61:32911: connect: Connection refused (error 111)
I20260808 05:10:26.850495 748 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:10:26.851145 769 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:26.851308 748 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:10:26.851382 748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/wal
uuid: "84d100ea3f9446cf95cdb5558ed7c4fd"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "e33556e91a689ad69187b8fab1b7c420"
server_key_iv: "b77ee8fb550c04c96ea44a60dc0aefcb"
server_key_version: "encryptionkey@0"
I20260808 05:10:26.851434 748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:26.864872 748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:26.866528 748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:26.866634 748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:26.870255 748 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.61:32911
I20260808 05:10:26.870297 854 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.61:32911 every 8 connection(s)
I20260808 05:10:26.870605 748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
I20260808 05:10:26.871460 856 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:26.873507 856 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:10:26.876175 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 748
I20260808 05:10:26.876346 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-1/wal/instance
I20260808 05:10:26.876611 13292 external_mini_cluster.cc:1428] Setting key c91f7cc33042b0fcbbad92d09b9dee0a
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.251.60@KRBTEST.COM; defaulting to no policy
I20260808 05:10:26.886979 739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.878835 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40500 (local address 127.12.251.62:36853)
0808 05:10:26.879367 (+ 532us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:26.879370 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:26.879384 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:10:26.879686 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:26.879688 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:26.879704 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:26.879755 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:26.880453 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.881051 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.882158 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.882377 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.882433 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.884429 (+ 1996us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:26.884431 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:26.884431 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:26.884438 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:26.885749 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.886107 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.886108 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.886108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.886164 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.886378 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.886379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.886379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.886495 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:26.886553 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:26.886804 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 05:10:26.886889 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500}
I20260808 05:10:26.887141 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.874297 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36853 (local address 127.0.0.1:40500)
0808 05:10:26.878908 (+ 4611us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.878968 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:26.879563 (+ 595us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:26.879839 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:26.879844 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:26.880136 (+ 292us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:26.880365 (+ 229us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.880370 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.881137 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.881138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.882080 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.882083 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.882446 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.882447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.882578 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.883080 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:26.883088 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:26.884345 (+ 1257us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:26.885820 (+ 1475us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.885827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.885829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.886043 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.886217 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.886218 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.886218 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.886323 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.886551 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:26.886558 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:26.886687 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 05:10:26.886774 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:10:26.886919 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4560,"thread_start_us":94,"threads_started":1}
I20260808 05:10:26.887640 856 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.60@KRBTEST.COM" created.
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:10:26.894431 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.887869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:37990)
0808 05:10:26.887917 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.887930 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:26.887981 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:26.888206 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:26.888207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:26.888347 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:26.888401 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.888403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.889514 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.889515 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.890005 (+ 490us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.890006 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.890423 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.890424 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.890491 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.890819 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:26.890823 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:26.891972 (+ 1149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:26.893535 (+ 1563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.893535 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.893536 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.893684 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.893853 (+ 169us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.893853 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.893854 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.893906 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.894146 (+ 240us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:26.894147 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:26.894183 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 05:10:26.894243 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:10:26.894337 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:10:26.894520 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.887944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37990 (local address 127.12.251.61:32911)
0808 05:10:26.888081 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:26.888085 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:26.888100 (+ 15us) server_negotiation.cc:407] Connection header received
0808 05:10:26.888117 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:26.888118 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:26.888128 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:26.888184 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:26.888464 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.889431 (+ 967us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.890084 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.890361 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.890420 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.892046 (+ 1626us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:26.892053 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:26.892054 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:26.892060 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:26.893465 (+ 1405us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.893750 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.893754 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.893754 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.893803 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.893954 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.893955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.893955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.894089 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:26.894158 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:26.894269 (+ 111us) server_negotiation.cc:299] Negotiation successful
0808 05:10:26.894407 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
I20260808 05:10:26.895064 856 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:10:26.895387 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.895286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52676)
0808 05:10:26.895323 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.895365 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 05:10:26.895490 776 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
I20260808 05:10:26.895841 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.895761 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52678)
0808 05:10:26.895796 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.895819 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 05:10:26.895938 856 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:34463: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab.
Entry for principal kudu/127.12.251.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab.
I20260808 05:10:26.903407 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:34463
--webserver_interface=127.12.251.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab
--principal=kudu/127.12.251.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:45219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:36853,127.12.251.61:32911,127.12.251.60:34463
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:26.940455 737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } attempt: 3
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:10:26.945174 856 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } attempt: 1
I20260808 05:10:26.945580 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.945449 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52690)
0808 05:10:26.945506 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.945544 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 05:10:26.946044 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.945954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52694)
0808 05:10:26.945994 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.946020 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 05:10:26.946600 856 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:34463: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
I20260808 05:10:26.947552 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.940906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38000 (local address 127.12.251.61:32911)
0808 05:10:26.940972 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:26.940974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:26.940993 (+ 19us) server_negotiation.cc:407] Connection header received
0808 05:10:26.941019 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:26.941020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:26.941031 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:26.941075 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:26.941430 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.941929 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.942616 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.942829 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.942886 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.944930 (+ 2044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:26.944932 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:26.944932 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:26.944940 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:26.946474 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.946848 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.946850 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.946850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.946904 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:26.947079 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:26.947080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:26.947081 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:26.947189 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:26.947245 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:26.947382 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:10:26.947458 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:10:26.947554 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.940821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:38000)
0808 05:10:26.940874 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.940886 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:26.940929 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:26.941089 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:26.941090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:26.941288 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:26.941355 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.941357 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.942013 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.942014 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.942539 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:26.942541 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:26.942895 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:26.942896 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:26.942973 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:26.943428 (+ 455us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:26.943433 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:26.944847 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:26.946564 (+ 1717us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.946565 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.946566 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.946775 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.946957 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:26.946958 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:26.946958 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:26.947028 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:26.947244 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:26.947245 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:26.947294 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 05:10:26.947353 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:10:26.947458 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 05:10:26.947921 737 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:10:26.948228 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.948136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52696)
0808 05:10:26.948177 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.948203 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 05:10:26.948552 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.948493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52698)
0808 05:10:26.948519 (+ 26us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.948540 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260808 05:10:26.948633 737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:34463: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
I20260808 05:10:26.979810 737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } attempt: 1
I20260808 05:10:26.980264 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.980147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52700)
0808 05:10:26.980202 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.980232 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:10:26.980636 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:26.980545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52704)
0808 05:10:26.980590 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:26.980617 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260808 05:10:26.980733 737 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:34463: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
W20260808 05:10:26.987078 865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:26.987262 865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:26.987282 865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:26.988314 865 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:26.988348 865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:26.988360 865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:26.988371 865 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:26.988389 865 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:26.989861 865 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:36853,127.12.251.61:32911,127.12.251.60:34463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab
--principal=kudu/127.12.251.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:34463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.251.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:26.990056 865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:26.990221 865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:26.994695 873 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:26.994802 865 server_base.cc:1034] running on GCE node
W20260808 05:10:26.994710 874 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:26.994710 877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:26.995182 865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:26.995429 865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:26.996568 865 hybrid_clock.cc:648] HybridClock initialized: now 1786165826996554 us; error 28 us; skew 500 ppm
Aug 08 05:10:26 dist-test-slave-bndk krb5kdc[616](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:26.998972 865 init.cc:377] Logged in from keytab as kudu/127.12.251.60@KRBTEST.COM (short username kudu)
I20260808 05:10:26.999372 865 webserver.cc:460] Webserver started at http://127.12.251.60:38893/ using document root <none> and password file <none>
I20260808 05:10:26.999579 865 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:26.999621 865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:26.999717 865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:27.000717 865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data/instance:
uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "f04ed6bc89a38b2a61e0531ab7891d18"
server_key_iv: "f85b1dcaf882afef38c6bd5b56e31a77"
server_key_version: "encryptionkey@0"
I20260808 05:10:27.001055 865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/wal/instance:
uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "f04ed6bc89a38b2a61e0531ab7891d18"
server_key_iv: "f85b1dcaf882afef38c6bd5b56e31a77"
server_key_version: "encryptionkey@0"
I20260808 05:10:27.002338 865 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:10:27.002995 887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:27.003139 865 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:10:27.003222 865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/wal
uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699"
format_stamp: "Formatted at 2026-08-08 05:10:26 on dist-test-slave-bndk"
server_key: "f04ed6bc89a38b2a61e0531ab7891d18"
server_key_iv: "f85b1dcaf882afef38c6bd5b56e31a77"
server_key_version: "encryptionkey@0"
I20260808 05:10:27.003278 865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:27.014739 856 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } attempt: 2
I20260808 05:10:27.015127 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.014990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52714)
0808 05:10:27.015047 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:27.015091 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:10:27.015455 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.015358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52726)
0808 05:10:27.015404 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:27.015432 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 05:10:27.015542 856 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:34463: Network error: Client connection negotiation failed: client connection to 127.12.251.60:34463: connect: Connection refused (error 111)
I20260808 05:10:27.016748 865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:27.018420 865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:27.018535 865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:27.022224 865 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.60:34463
I20260808 05:10:27.022257 979 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.60:34463 every 8 connection(s)
I20260808 05:10:27.022567 865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
I20260808 05:10:27.023355 981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:27.024801 981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:10:27.029726 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 865
I20260808 05:10:27.029819 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786165676707025-13292-0/minicluster-data/master-2/wal/instance
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:27.030006 13292 external_mini_cluster.cc:1428] Setting key da64fc96a389a1004bca79309da33732
I20260808 05:10:27.033964 739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.025459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40506 (local address 127.12.251.62:36853)
0808 05:10:27.025515 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.025517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.025699 (+ 182us) server_negotiation.cc:407] Connection header received
0808 05:10:27.026166 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.026167 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.026179 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.026229 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.026790 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.027252 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.028175 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.028376 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.028432 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.030455 (+ 2023us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.030457 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.030457 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.030466 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.032561 (+ 2095us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.033022 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.033023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.033024 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.033083 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.033369 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.033370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.033370 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.033503 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.033571 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.033793 (+ 222us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.033880 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:10:27.034098 983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.025430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36853 (local address 127.0.0.1:40506)
0808 05:10:27.025595 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:27.025628 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:27.026072 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:27.026293 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:27.026296 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:27.026528 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:27.026707 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.026711 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.027329 (+ 618us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.027330 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.028096 (+ 766us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.028098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.028445 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.028445 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.028568 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.028939 (+ 371us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:27.028957 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:27.030346 (+ 1389us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:27.032628 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.032635 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.032637 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.032917 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.033144 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.033145 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.033145 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.033309 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.033565 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:27.033569 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:27.033679 (+ 110us) client_negotiation.cc:769] Sending connection context
0808 05:10:27.033756 (+ 77us) client_negotiation.cc:240] Negotiation successful
0808 05:10:27.033875 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":84,"threads_started":1}
I20260808 05:10:27.034634 981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:10:27.038529 986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.030433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52732 (local address 127.12.251.60:34463)
0808 05:10:27.030596 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.030600 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.030627 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:10:27.030681 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.030683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.030695 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.030776 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.031382 (+ 606us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.032467 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.033385 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.033797 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.033864 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.036036 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.036043 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.036044 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.036050 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.037494 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.037789 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.037792 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.037793 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.037842 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.038010 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.038010 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.038011 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.038134 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.038265 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.038331 (+ 66us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.038425 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":82,"threads_started":1}
I20260808 05:10:27.041149 983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.034858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:32911 (local address 127.0.0.1:38014)
0808 05:10:27.034951 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:27.034961 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:27.035008 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:27.035112 (+ 104us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:27.035113 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:27.035238 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:27.035283 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.035285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.035913 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.035914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.036521 (+ 607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.036523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.036941 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.036942 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.037011 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.037367 (+ 356us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:27.037372 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:27.038449 (+ 1077us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:27.040297 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.040298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.040298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.040510 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.040665 (+ 155us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.040665 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.040666 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.040725 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.040907 (+ 182us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:27.040908 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:27.040945 (+ 37us) client_negotiation.cc:769] Sending connection context
0808 05:10:27.041012 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:10:27.041093 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80}
I20260808 05:10:27.041236 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.034911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38014 (local address 127.12.251.61:32911)
0808 05:10:27.034951 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.034952 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.034995 (+ 43us) server_negotiation.cc:407] Connection header received
0808 05:10:27.035057 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.035058 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.035067 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.035111 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.035350 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.035844 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.036593 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.036872 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.036936 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.038521 (+ 1585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.038522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.038523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.038530 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.040241 (+ 1711us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.040573 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.040574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.040574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.040615 (+ 41us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.040775 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.040775 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.040775 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.040861 (+ 86us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.040903 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.041053 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.041128 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:10:27.041512 981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:10:27.045620 739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.039232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40512 (local address 127.12.251.62:36853)
0808 05:10:27.039268 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.039269 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.039278 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:10:27.039299 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.039300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.039308 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.039352 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.039771 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.040198 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.041020 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.041321 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.041382 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.043374 (+ 1992us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.043375 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.043375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.043382 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.044585 (+ 1203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.044870 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.044871 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.044871 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.044927 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.045072 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.045073 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.045073 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.045193 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.045413 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.045454 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.045531 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:10:27.047391 983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.041725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52742)
0808 05:10:27.041772 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:27.041782 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:27.041818 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:27.041951 (+ 133us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:27.041952 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:27.042088 (+ 136us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:27.042121 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.042123 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.042694 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.042694 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.043199 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.043201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.043617 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.043618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.043678 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.043965 (+ 287us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:27.043970 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:27.045037 (+ 1067us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:27.046578 (+ 1541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.046579 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.046580 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.046772 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.046946 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.046946 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.046947 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.046994 (+ 47us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.047211 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:27.047211 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:27.047240 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 05:10:27.047281 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 05:10:27.047338 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 05:10:27.047487 986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.041757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52742 (local address 127.12.251.60:34463)
0808 05:10:27.041868 (+ 111us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.041869 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.041873 (+ 4us) server_negotiation.cc:407] Connection header received
0808 05:10:27.041884 (+ 11us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.041885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.041891 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.041923 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.042188 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.042624 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.043278 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.043543 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.043602 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.045111 (+ 1509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.045111 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.045112 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.045117 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.046507 (+ 1390us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.046834 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.046835 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.046835 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.046893 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.047044 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.047044 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.047044 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.047156 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.047219 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.047304 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.047391 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":102}
I20260808 05:10:27.048861 981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699: Bootstrap starting.
I20260808 05:10:27.049909 981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:27.050189 981 log.cc:824] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699: Log is configured to *not* fsync() on all Append() calls
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:10:27.050872 981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699: No bootstrap required, opened a new log
I20260808 05:10:27.052223 981 raft_consensus.cc:348] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.052340 981 raft_consensus.cc:374] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:27.052371 981 raft_consensus.cc:729] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9ecbd29ff924f0b8ebf6e0b8b0af699, State: Initialized, Role: FOLLOWER
I20260808 05:10:27.052527 981 consensus_queue.cc:260] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.052800 988 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.052850 981 sys_catalog.cc:564] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:27.052969 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.046211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.12.251.61:32911)
0808 05:10:27.046252 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.046253 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.046263 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:10:27.046282 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.046283 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.046292 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.046334 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.046797 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.047427 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.048275 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.048460 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.048508 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.050737 (+ 2229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.050738 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.050739 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.050745 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.051942 (+ 1197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.052225 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.052226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.052226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.052273 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.052436 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.052437 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.052437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.052579 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.052769 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.052812 (+ 43us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.052891 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:10:27.054301 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:10:27.054294 988 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:10:27.054836 1002 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:10:27.054883 1002 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:10:27.055896 737 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } attempt: 2
I20260808 05:10:27.055006 865 master_runner.cc:186] Error getting master registration for 127.12.251.62:36853: OK, instance_id { permanent_uuid: "921dc0c7149845229709b01722b124e0" instance_seqno: 1786165826715988 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:10:27.057102 865 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:10:27.063271 861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.055828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38024 (local address 127.12.251.61:32911)
0808 05:10:27.055875 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.055877 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.056440 (+ 563us) server_negotiation.cc:407] Connection header received
0808 05:10:27.056486 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.056487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.056497 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.056544 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.057168 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.057882 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.058867 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.059146 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.059184 (+ 38us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.060619 (+ 1435us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.060620 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.060620 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.060627 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.062038 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.062422 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.062424 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.062424 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.062486 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.062711 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.062713 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.062713 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.062834 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.062915 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.063115 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.063184 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:10:27.064407 739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.055624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40520 (local address 127.12.251.62:36853)
0808 05:10:27.055658 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.055660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.056567 (+ 907us) server_negotiation.cc:407] Connection header received
0808 05:10:27.056650 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.056651 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.056660 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.056687 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.057281 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.057957 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.058867 (+ 910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.059157 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.059190 (+ 33us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.060776 (+ 1586us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.060777 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.060778 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.060784 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.062988 (+ 2204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.063331 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.063332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.063333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.063392 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.063630 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.063631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.063631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.063752 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.063830 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.064234 (+ 404us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.064306 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:10:27.064522 986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.056180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52768 (local address 127.12.251.60:34463)
0808 05:10:27.057166 (+ 986us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.057168 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.057176 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:10:27.057192 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.057193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.057201 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.057276 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.057672 (+ 396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.058353 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.059284 (+ 931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.059561 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.059616 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.061588 (+ 1972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.061589 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.061589 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.061596 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.063182 (+ 1586us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.063550 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.063551 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.063551 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.063607 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.063793 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.063794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.063794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.063942 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.064015 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.064368 (+ 353us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.064441 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":969,"thread_start_us":69,"threads_started":1}
I20260808 05:10:27.064833 740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.056120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52768)
0808 05:10:27.056160 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:27.056172 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:27.056218 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:27.057347 (+ 1129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:27.057348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:27.057498 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:27.057538 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.057540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.058445 (+ 905us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.058447 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.059191 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.059194 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.059664 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.059665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.059718 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.060039 (+ 321us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:27.060044 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:27.061486 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:27.063273 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.063274 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.063274 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.063471 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.063672 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.063673 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.063673 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.063732 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.064048 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:27.064049 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:27.064095 (+ 46us) client_negotiation.cc:769] Sending connection context
0808 05:10:27.064154 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:10:27.064246 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 05:10:27.066329 737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: Bootstrap starting.
I20260808 05:10:27.067337 737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:27.067591 737 log.cc:824] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:27.068444 737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: No bootstrap required, opened a new log
I20260808 05:10:27.070178 1013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.055901 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52756 (local address 127.12.251.60:34463)
0808 05:10:27.056301 (+ 400us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.056303 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.063740 (+ 7437us) server_negotiation.cc:407] Connection header received
0808 05:10:27.063761 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.063762 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.063772 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.063832 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.064304 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.065050 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.065874 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.066188 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.066258 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.067393 (+ 1135us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.067394 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.067395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.067400 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.068959 (+ 1559us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.069361 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.069362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.069362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.069419 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.069638 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.069639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.069639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.069761 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.069847 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.069990 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.070070 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":381}
I20260808 05:10:27.070466 737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.070649 737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:27.070700 737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 921dc0c7149845229709b01722b124e0, State: Initialized, Role: FOLLOWER
I20260808 05:10:27.070820 737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.071070 1020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.071117 737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:27.072306 1020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:10:27.072808 1036 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:10:27.072901 1036 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:10:27.073423 641 master_runner.cc:186] Error getting master registration for 127.12.251.61:32911: OK, instance_id { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" instance_seqno: 1786165826869191 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:10:27.075686 641 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:10:27.106675 856 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } attempt: 3
Aug 08 05:10:27 dist-test-slave-bndk krb5kdc[616](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165826, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:10:27.113377 859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.106971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:34463 (local address 127.0.0.1:52784)
0808 05:10:27.107024 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:27.107035 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:27.107074 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:27.107198 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:27.107199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:27.107363 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:27.107405 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.107406 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.108090 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.108091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.108586 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:27.108587 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.109387 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.109388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:27.109450 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.109852 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:27.109857 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:27.111012 (+ 1155us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:27.112435 (+ 1423us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.112436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.112436 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.112606 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.112769 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:27.112770 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:27.112771 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:27.112827 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:27.113043 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:27.113044 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:27.113091 (+ 47us) client_negotiation.cc:769] Sending connection context
0808 05:10:27.113149 (+ 58us) client_negotiation.cc:240] Negotiation successful
0808 05:10:27.113279 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:10:27.113377 1013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:27.107015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52784 (local address 127.12.251.60:34463)
0808 05:10:27.107052 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:27.107053 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:27.107061 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:10:27.107121 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:27.107122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:27.107133 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:27.107181 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:27.107480 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.108021 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.108662 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:27.108857 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:27.108914 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:27.111087 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:27.111089 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:27.111089 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:27.111097 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:27.112359 (+ 1262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.112665 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.112666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.112667 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.112717 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:27.112875 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:27.112876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:27.112876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:27.112988 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:27.113044 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:27.113179 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 05:10:27.113279 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:10:27.114786 856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: Bootstrap starting.
I20260808 05:10:27.115419 856 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:27.115713 856 log.cc:824] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:27.116436 856 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: No bootstrap required, opened a new log
I20260808 05:10:27.117961 856 raft_consensus.cc:348] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.118079 856 raft_consensus.cc:374] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:27.118113 856 raft_consensus.cc:729] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 84d100ea3f9446cf95cdb5558ed7c4fd, State: Initialized, Role: FOLLOWER
I20260808 05:10:27.118265 856 consensus_queue.cc:260] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.118518 1040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.118634 856 sys_catalog.cc:564] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:27.118654 1040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:10:27.120814 1059 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:10:27.120919 1059 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:10:27.123595 748 master_runner.cc:263] No leader master found from master 84d100ea3f9446cf95cdb5558ed7c4fd
I20260808 05:10:27.123642 748 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:10:27.149408 988 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:27.149531 988 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.149752 988 leader_election.cc:288] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 921dc0c7149845229709b01722b124e0 (127.12.251.62:36853), 84d100ea3f9446cf95cdb5558ed7c4fd (127.12.251.61:32911)
I20260808 05:10:27.150226 809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" is_pre_election: true
I20260808 05:10:27.150377 809 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9ecbd29ff924f0b8ebf6e0b8b0af699 in term 0.
I20260808 05:10:27.150583 888 leader_election.cc:302] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 84d100ea3f9446cf95cdb5558ed7c4fd, f9ecbd29ff924f0b8ebf6e0b8b0af699; no voters:
I20260808 05:10:27.150883 696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "921dc0c7149845229709b01722b124e0" is_pre_election: true
I20260808 05:10:27.151032 696 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f9ecbd29ff924f0b8ebf6e0b8b0af699 in term 0.
I20260808 05:10:27.151394 988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:10:27.151449 988 raft_consensus.cc:482] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:10:27.151473 988 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:27.152383 988 raft_consensus.cc:504] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.152499 988 leader_election.cc:288] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [CANDIDATE]: Term 1 election: Requested vote from peers 921dc0c7149845229709b01722b124e0 (127.12.251.62:36853), 84d100ea3f9446cf95cdb5558ed7c4fd (127.12.251.61:32911)
I20260808 05:10:27.152840 696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "921dc0c7149845229709b01722b124e0"
I20260808 05:10:27.152910 696 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:27.153761 696 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9ecbd29ff924f0b8ebf6e0b8b0af699 in term 1.
I20260808 05:10:27.154021 896 leader_election.cc:302] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 921dc0c7149845229709b01722b124e0, f9ecbd29ff924f0b8ebf6e0b8b0af699; no voters:
I20260808 05:10:27.154150 809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd"
I20260808 05:10:27.154217 809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:27.155119 809 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f9ecbd29ff924f0b8ebf6e0b8b0af699 in term 1.
I20260808 05:10:27.155406 988 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:27.155570 988 raft_consensus.cc:686] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [term 1 LEADER]: Becoming Leader. State: Replica: f9ecbd29ff924f0b8ebf6e0b8b0af699, State: Running, Role: LEADER
I20260808 05:10:27.155656 988 consensus_queue.cc:237] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } }
I20260808 05:10:27.156025 988 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9ecbd29ff924f0b8ebf6e0b8b0af699. Latest consensus state: current_term: 1 leader_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.156090 988 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:27.156378 1063 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:27.156596 1063 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:10:27.158504 809 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [term 1 FOLLOWER]: Refusing update from remote peer f9ecbd29ff924f0b8ebf6e0b8b0af699: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:27.158849 988 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:27.160070 1040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9ecbd29ff924f0b8ebf6e0b8b0af699. Latest consensus state: current_term: 1 leader_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.160151 1040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:10:27.161329 696 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [term 1 FOLLOWER]: Refusing update from remote peer f9ecbd29ff924f0b8ebf6e0b8b0af699: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:27.161614 988 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [LEADER]: Connected to new peer: Peer: permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:27.162721 1020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f9ecbd29ff924f0b8ebf6e0b8b0af699. Latest consensus state: current_term: 1 leader_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.162801 1020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:10:27.164145 1061 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.164222 1061 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:27.164618 1020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.164692 1020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:10:27.164929 1065 mvcc.cc:205] Tried to move back new op lower bound from 7316135228039217152 to 7316135228030164992. Current Snapshot: MvccSnapshot[applied={T|T < 7316135228039217152}]
I20260808 05:10:27.165357 988 sys_catalog.cc:455] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.165434 988 sys_catalog.cc:458] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:27.165872 1040 sys_catalog.cc:455] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "921dc0c7149845229709b01722b124e0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36853 } } peers { permanent_uuid: "84d100ea3f9446cf95cdb5558ed7c4fd" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 32911 } } peers { permanent_uuid: "f9ecbd29ff924f0b8ebf6e0b8b0af699" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 34463 } } }
I20260808 05:10:27.165963 1040 sys_catalog.cc:458] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:10:27.166535 1066 mvcc.cc:205] Tried to move back new op lower bound from 7316135228039217152 to 7316135228030164992. Current Snapshot: MvccSnapshot[applied={T|T < 7316135228039217152}]
I20260808 05:10:27.166935 1070 mvcc.cc:205] Tried to move back new op lower bound from 7316135228039217152 to 7316135228030164992. Current Snapshot: MvccSnapshot[applied={T|T < 7316135228039217152}]
I20260808 05:10:27.167521 1063 catalog_manager.cc:1347] Generated new cluster ID: 852c6aba67514374b1d474877aca0259
I20260808 05:10:27.167564 1063 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:10:27.198963 1063 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:10:27.199755 1063 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:10:27.215281 1063 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f9ecbd29ff924f0b8ebf6e0b8b0af699: Generated new TSK 0
I20260808 05:10:27.215597 1063 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:10:28.073410 1036 catalog_manager.cc:1259] Loaded cluster ID: 852c6aba67514374b1d474877aca0259
I20260808 05:10:28.073493 1036 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: loading cluster ID for follower catalog manager: success
I20260808 05:10:28.074290 1036 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: acquiring CA information for follower catalog manager: success
I20260808 05:10:28.074596 1036 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 921dc0c7149845229709b01722b124e0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:10:28.121410 1059 catalog_manager.cc:1259] Loaded cluster ID: 852c6aba67514374b1d474877aca0259
I20260808 05:10:28.121486 1059 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: loading cluster ID for follower catalog manager: success
I20260808 05:10:28.122314 1059 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: acquiring CA information for follower catalog manager: success
I20260808 05:10:28.122628 1059 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 84d100ea3f9446cf95cdb5558ed7c4fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:10:28.271710 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 641
I20260808 05:10:28.284003 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 748
I20260808 05:10:28.294258 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 865
2026-08-08T05:10:28Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2946 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:10:28 dist-test-slave-bndk krb5kdc[1087](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:10:28 dist-test-slave-bndk krb5kdc[1087](info): set up 2 sockets
Aug 08 05:10:28 dist-test-slave-bndk krb5kdc[1087](info): commencing operation
krb5kdc: starting...
W20260808 05:10:29.415343 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:10:29 dist-test-slave-bndk krb5kdc[1087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:10:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:10:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:10:29.529996 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44211
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:41825
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:44211
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:29.610749 1109 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:29.610960 1109 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:29.610989 1109 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:29.612105 1109 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:29.612144 1109 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:29.612162 1109 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:29.612178 1109 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:29.612193 1109 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:29.613639 1109 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:41825
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:44211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1109
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:29.613865 1109 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:29.614073 1109 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:29.618682 1121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:29.618710 1118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:29.618666 1117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:29.618930 1109 server_base.cc:1034] running on GCE node
I20260808 05:10:29.619181 1109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:29.619446 1109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:29.620584 1109 hybrid_clock.cc:648] HybridClock initialized: now 1786165829620570 us; error 32 us; skew 500 ppm
Aug 08 05:10:29 dist-test-slave-bndk krb5kdc[1087](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165829, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:29.623050 1109 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:29.623476 1109 webserver.cc:460] Webserver started at http://127.12.251.62:36477/ using document root <none> and password file <none>
I20260808 05:10:29.623667 1109 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:29.623710 1109 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:29.623831 1109 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:29.624850 1109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "fdee45d815174accab78cfdadcd473d0"
format_stamp: "Formatted at 2026-08-08 05:10:29 on dist-test-slave-bndk"
server_key: "ac3c769092236107bc374c5dd1fed113"
server_key_iv: "4a28d09a5cb854ad47aa36c20407c384"
server_key_version: "encryptionkey@0"
I20260808 05:10:29.625146 1109 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "fdee45d815174accab78cfdadcd473d0"
format_stamp: "Formatted at 2026-08-08 05:10:29 on dist-test-slave-bndk"
server_key: "ac3c769092236107bc374c5dd1fed113"
server_key_iv: "4a28d09a5cb854ad47aa36c20407c384"
server_key_version: "encryptionkey@0"
I20260808 05:10:29.626500 1109 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:10:29.627149 1131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:29.627296 1109 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:10:29.627372 1109 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "fdee45d815174accab78cfdadcd473d0"
format_stamp: "Formatted at 2026-08-08 05:10:29 on dist-test-slave-bndk"
server_key: "ac3c769092236107bc374c5dd1fed113"
server_key_iv: "4a28d09a5cb854ad47aa36c20407c384"
server_key_version: "encryptionkey@0"
I20260808 05:10:29.627439 1109 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:29.642480 1109 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:29.644465 1109 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:29.644586 1109 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:29.648473 1109 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:44211
I20260808 05:10:29.648535 1205 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:44211 every 8 connection(s)
I20260808 05:10:29.648819 1109 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:29.649650 1206 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:29.651988 1206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0: Bootstrap starting.
I20260808 05:10:29.652659 1206 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:29.652942 1206 log.cc:824] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:29.653674 1206 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0: No bootstrap required, opened a new log
I20260808 05:10:29.654352 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 1109
I20260808 05:10:29.654434 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:10:29.654625 13292 external_mini_cluster.cc:1428] Setting key 86165cbab8094b2d961d6677fbd4fb39
I20260808 05:10:29.655701 1206 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee45d815174accab78cfdadcd473d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44211 } }
I20260808 05:10:29.655875 1206 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:29.655947 1206 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdee45d815174accab78cfdadcd473d0, State: Initialized, Role: FOLLOWER
I20260808 05:10:29.656091 1206 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee45d815174accab78cfdadcd473d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44211 } }
I20260808 05:10:29.656169 1206 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:10:29.656193 1206 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:10:29.656239 1206 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:29.657292 1206 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee45d815174accab78cfdadcd473d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44211 } }
I20260808 05:10:29.657403 1206 leader_election.cc:302] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdee45d815174accab78cfdadcd473d0; no voters:
I20260808 05:10:29.657558 1206 leader_election.cc:288] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:10:29.657586 1212 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:29.657747 1212 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [term 1 LEADER]: Becoming Leader. State: Replica: fdee45d815174accab78cfdadcd473d0, State: Running, Role: LEADER
I20260808 05:10:29.657783 1206 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:29.657907 1212 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee45d815174accab78cfdadcd473d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44211 } }
I20260808 05:10:29.659236 1213 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdee45d815174accab78cfdadcd473d0. Latest consensus state: current_term: 1 leader_uuid: "fdee45d815174accab78cfdadcd473d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee45d815174accab78cfdadcd473d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44211 } } }
I20260808 05:10:29.659251 1214 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdee45d815174accab78cfdadcd473d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdee45d815174accab78cfdadcd473d0" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44211 } } }
I20260808 05:10:29.659353 1213 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:29.659489 1214 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0 [sys.catalog]: This master's current role is: LEADER
W20260808 05:10:29.659664 1230 catalog_manager.cc:1558] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:10:29.659715 1230 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:10:29.659765 1232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:29.659900 1232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:10:29.661329 1232 catalog_manager.cc:1347] Generated new cluster ID: 7fd82781fc7c4872b8e68b547a79f06e
I20260808 05:10:29.661375 1232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:10:29 dist-test-slave-bndk krb5kdc[1087](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165829, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:29.669008 1232 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:10:29.669338 1211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:29.655091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49538 (local address 127.12.251.62:44211)
0808 05:10:29.655288 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:29.655298 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:29.655334 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:10:29.655669 (+ 335us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:29.655678 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:29.655742 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:29.655884 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:29.656602 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:29.658023 (+ 1421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:29.659051 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:29.659644 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:29.659747 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:29.665728 (+ 5981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:29.665733 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:29.665733 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:29.665746 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:29.667676 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:29.668071 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:29.668074 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:29.668075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:29.668202 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:29.668393 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:29.668393 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:29.668394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:29.668679 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:29.668838 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:29.668956 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 05:10:29.669099 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":74,"threads_started":1}
I20260808 05:10:29.669958 1232 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:10:29.670254 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:10:29.676432 1232 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdee45d815174accab78cfdadcd473d0: Generated new TSK 0
I20260808 05:10:29.676601 1232 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:10:29.723699 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 1109
2026-08-08T05:10:29Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1430 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:10:29 dist-test-slave-bndk krb5kdc[1238](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:10:29 dist-test-slave-bndk krb5kdc[1238](info): set up 2 sockets
Aug 08 05:10:29 dist-test-slave-bndk krb5kdc[1238](info): commencing operation
krb5kdc: starting...
W20260808 05:10:30.862869 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.115s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:10:30 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:10:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:10:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:10:30.976262 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39893
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:39893
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:31.056679 1253 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:31.056874 1253 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:31.056895 1253 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:31.058017 1253 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:31.058058 1253 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:31.058070 1253 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:31.058094 1253 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:31.058116 1253 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:31.059554 1253 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:39893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1253
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:31.059770 1253 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:31.059976 1253 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:31.064560 1263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:31.064700 1253 server_base.cc:1034] running on GCE node
W20260808 05:10:31.064569 1265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.064569 1261 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:31.065032 1253 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:31.065320 1253 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:31.066455 1253 hybrid_clock.cc:648] HybridClock initialized: now 1786165831066438 us; error 34 us; skew 500 ppm
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:31.068825 1253 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:31.069191 1253 webserver.cc:460] Webserver started at http://127.12.251.62:45865/ using document root <none> and password file <none>
I20260808 05:10:31.069393 1253 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:31.069438 1253 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:31.069536 1253 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:31.070493 1253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "a0da6326dfc84272a39099f55fd7cef5"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "203a43205b8534cf587cb201eae6ccef"
server_key_iv: "21e2399e949870dadda0971c34043c97"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.070786 1253 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "a0da6326dfc84272a39099f55fd7cef5"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "203a43205b8534cf587cb201eae6ccef"
server_key_iv: "21e2399e949870dadda0971c34043c97"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.071964 1253 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:10:31.072585 1278 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.072731 1253 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:10:31.072817 1253 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "a0da6326dfc84272a39099f55fd7cef5"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "203a43205b8534cf587cb201eae6ccef"
server_key_iv: "21e2399e949870dadda0971c34043c97"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.072877 1253 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:31.080488 1253 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:31.082468 1253 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:31.082605 1253 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:31.086333 1253 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:39893
I20260808 05:10:31.086373 1360 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:39893 every 8 connection(s)
I20260808 05:10:31.086680 1253 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:31.087637 1361 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:31.089938 1361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Bootstrap starting.
I20260808 05:10:31.090524 1361 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:31.090655 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 1253
I20260808 05:10:31.090757 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:10:31.090802 1361 log.cc:824] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:31.090953 13292 external_mini_cluster.cc:1428] Setting key 0a10690a71af1ee57256982bc0cce6c5
I20260808 05:10:31.091567 1361 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: No bootstrap required, opened a new log
I20260808 05:10:31.094126 1361 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.094354 1361 raft_consensus.cc:374] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:31.094411 1361 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0da6326dfc84272a39099f55fd7cef5, State: Initialized, Role: FOLLOWER
I20260808 05:10:31.094533 1361 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.094628 1361 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:10:31.094662 1361 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:10:31.094705 1361 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:31.095264 1361 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.095369 1361 leader_election.cc:302] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0da6326dfc84272a39099f55fd7cef5; no voters:
I20260808 05:10:31.095570 1361 leader_election.cc:288] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:10:31.095593 1370 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:31.095755 1370 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 LEADER]: Becoming Leader. State: Replica: a0da6326dfc84272a39099f55fd7cef5, State: Running, Role: LEADER
I20260808 05:10:31.095849 1361 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:31.095861 1370 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.096208 1370 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0da6326dfc84272a39099f55fd7cef5. Latest consensus state: current_term: 1 leader_uuid: "a0da6326dfc84272a39099f55fd7cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } } }
I20260808 05:10:31.096444 1370 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:31.096374 1371 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a0da6326dfc84272a39099f55fd7cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } } }
I20260808 05:10:31.096846 1371 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:31.097121 1383 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:31.097631 1383 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165830, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:31.099165 1383 catalog_manager.cc:1347] Generated new cluster ID: 24c2894de6894ad9bf6cced604c6d144
I20260808 05:10:31.099211 1383 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:10:31.103807 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.091415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43604 (local address 127.12.251.62:39893)
0808 05:10:31.091582 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.091591 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.091622 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:10:31.092050 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.092057 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.092105 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.092212 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:31.093015 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.093912 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.094931 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.095330 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.095437 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.098148 (+ 2711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:31.098153 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:31.098153 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:31.098165 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:31.102227 (+ 4062us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.102632 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.102635 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.102636 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.102730 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.102945 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.102946 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.102946 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.103211 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:31.103348 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.103476 (+ 128us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.103610 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118,"thread_start_us":79,"threads_started":1}
I20260808 05:10:31.105362 1383 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:10:31.105844 1383 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:10:31.111495 1383 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Generated new TSK 0
I20260808 05:10:31.111640 1383 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:10:31.138331 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39893
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:31.221810 1401 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:31.222007 1401 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:31.222038 1401 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:31.223208 1401 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:31.223253 1401 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:31.223287 1401 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:10:31.224732 1401 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1401
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:31.224972 1401 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:31.225194 1401 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:31.230038 1409 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.230051 1411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.230319 1407 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:31.230270 1401 server_base.cc:1034] running on GCE node
I20260808 05:10:31.230525 1401 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:31.230743 1401 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:31.231889 1401 hybrid_clock.cc:648] HybridClock initialized: now 1786165831231868 us; error 29 us; skew 500 ppm
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:31.234457 1401 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:10:31.234876 1401 webserver.cc:460] Webserver started at http://127.12.251.1:41711/ using document root <none> and password file <none>
I20260808 05:10:31.235067 1401 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:31.235116 1401 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:31.235239 1401 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:31.236258 1401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "af8bbc03c7304e1f8963bd5b39c54d68"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "953908be1dc223de59184548bfe8fd38"
server_key_iv: "13c199e843a3ae9206ea377ad3c29ab1"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.236594 1401 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "af8bbc03c7304e1f8963bd5b39c54d68"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "953908be1dc223de59184548bfe8fd38"
server_key_iv: "13c199e843a3ae9206ea377ad3c29ab1"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.237882 1401 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:10:31.238605 1424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.238755 1401 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:10:31.238842 1401 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "af8bbc03c7304e1f8963bd5b39c54d68"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "953908be1dc223de59184548bfe8fd38"
server_key_iv: "13c199e843a3ae9206ea377ad3c29ab1"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.238910 1401 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:31.251096 1401 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:31.253129 1401 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:31.253283 1401 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:31.253492 1401 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:31.253764 1401 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:31.253796 1401 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.253824 1401 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:31.253841 1401 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.259128 1401 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:36285
I20260808 05:10:31.259183 1586 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:36285 every 8 connection(s)
I20260808 05:10:31.259459 1401 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:10:31.263181 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 1401
I20260808 05:10:31.263298 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:10:31.263520 13292 external_mini_cluster.cc:1428] Setting key bf13229437e809f473326f6295c2d712
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:31.268244 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.260100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:60567 (local address 127.12.251.62:39893)
0808 05:10:31.260143 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.260145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.260332 (+ 187us) server_negotiation.cc:407] Connection header received
0808 05:10:31.260793 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.260794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.260802 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.260859 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:31.261786 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.262300 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.263239 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.263543 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.263613 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.265737 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:31.265739 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:31.265739 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:31.265746 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:31.267002 (+ 1256us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.267360 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.267361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.267362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.267414 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.267644 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.267644 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.267645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.267749 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:31.267805 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.268061 (+ 256us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.268152 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:10:31.268388 1589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.260063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:60567)
0808 05:10:31.260216 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.260257 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.260718 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.260912 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.260915 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.261518 (+ 603us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:31.261703 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.261708 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.262366 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.262367 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.263144 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.263146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.263624 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.263626 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.263734 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.264219 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:31.264229 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:31.265634 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:31.267077 (+ 1443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:31.267084 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:31.267086 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:31.267295 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:31.267485 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:31.267486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:31.267487 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:31.267587 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:31.267805 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:31.267812 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:31.267944 (+ 132us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.268033 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.268182 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":83,"threads_started":1}
I20260808 05:10:31.268883 1587 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39893
I20260808 05:10:31.268975 1587 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:31.269141 1587 heartbeater.cc:511] Master 127.12.251.62:39893 requested a full tablet report, sending...
I20260808 05:10:31.269671 1305 ts_manager.cc:194] Registered new tserver with Master: af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285)
I20260808 05:10:31.270249 1305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:60567
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:10:31.289553 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39893
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:31.372560 1593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:31.372756 1593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:31.372777 1593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:31.373867 1593 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:31.373901 1593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:31.373925 1593 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:10:31.375370 1593 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1593
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:31.375609 1593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:31.375804 1593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:31.380672 1604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.380721 1601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.380738 1606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:31.381116 1593 server_base.cc:1034] running on GCE node
I20260808 05:10:31.381354 1593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:31.381579 1593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:31.382730 1593 hybrid_clock.cc:648] HybridClock initialized: now 1786165831382714 us; error 28 us; skew 500 ppm
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:31.385094 1593 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:10:31.385545 1593 webserver.cc:460] Webserver started at http://127.12.251.2:38491/ using document root <none> and password file <none>
I20260808 05:10:31.385747 1593 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:31.385803 1593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:31.385931 1593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:31.386962 1593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "044db0bb03a2e83a21fadaf843e538cc"
server_key_iv: "eae5c652256acb39d9be119072bf379b"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.387296 1593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "044db0bb03a2e83a21fadaf843e538cc"
server_key_iv: "eae5c652256acb39d9be119072bf379b"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.388525 1593 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:10:31.389199 1614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.389374 1593 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:10:31.389459 1593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "044db0bb03a2e83a21fadaf843e538cc"
server_key_iv: "eae5c652256acb39d9be119072bf379b"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.389521 1593 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:31.401844 1593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:31.403683 1593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:31.403851 1593 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:31.404078 1593 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:31.404433 1593 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:31.404472 1593 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.404501 1593 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:31.404518 1593 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.409961 1593 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:46061
I20260808 05:10:31.410028 1807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:46061 every 8 connection(s)
I20260808 05:10:31.410301 1593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:10:31.414870 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 1593
I20260808 05:10:31.414966 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:10:31.415135 13292 external_mini_cluster.cc:1428] Setting key 2e679a912988c2100bd0f0d269cf12e6
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:31.419229 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.410953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:41569 (local address 127.12.251.62:39893)
0808 05:10:31.411035 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.411043 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.411227 (+ 184us) server_negotiation.cc:407] Connection header received
0808 05:10:31.411740 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.411741 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.411750 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.411800 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:31.412702 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.413188 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.414170 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.414350 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.414393 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.416494 (+ 2101us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:31.416495 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:31.416496 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:31.416504 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:31.417847 (+ 1343us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.418299 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.418300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.418301 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.418363 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.418623 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.418623 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.418624 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.418722 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:31.418784 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.419056 (+ 272us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.419141 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:10:31.419296 1811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.410926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:41569)
0808 05:10:31.411104 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.411138 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.411657 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.411879 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.411882 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.412426 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:31.412614 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.412620 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.413305 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.413306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.414107 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.414109 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.414400 (+ 291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.414401 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.414494 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.414967 (+ 473us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:31.414977 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:31.416409 (+ 1432us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:31.417922 (+ 1513us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:31.417929 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:31.417931 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:31.418213 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:31.418427 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:31.418428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:31.418428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:31.418565 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:31.418780 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:31.418786 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:31.418926 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.419014 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.419137 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":100,"threads_started":1}
I20260808 05:10:31.419852 1808 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39893
I20260808 05:10:31.419951 1808 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:31.420169 1808 heartbeater.cc:511] Master 127.12.251.62:39893 requested a full tablet report, sending...
I20260808 05:10:31.420568 1305 ts_manager.cc:194] Registered new tserver with Master: 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061)
I20260808 05:10:31.420915 1305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:41569
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:10:31.440956 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39893
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:31.520767 1816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:31.520967 1816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:31.520988 1816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:31.522106 1816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:31.522145 1816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:31.522171 1816 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:10:31.523578 1816 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:31.523803 1816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:31.524012 1816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:31.528680 1829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.528712 1823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:31.528822 1816 server_base.cc:1034] running on GCE node
W20260808 05:10:31.528679 1825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:31.529017 1816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:31.529268 1816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:31.530422 1816 hybrid_clock.cc:648] HybridClock initialized: now 1786165831530407 us; error 31 us; skew 500 ppm
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:31.532696 1816 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:10:31.533095 1816 webserver.cc:460] Webserver started at http://127.12.251.3:45025/ using document root <none> and password file <none>
I20260808 05:10:31.533332 1816 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:31.533383 1816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:31.533507 1816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:31.534492 1816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "95aa46670b7842b98db3ae3999e76a97"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "ef46ee9281ddc75e86781d90797564e2"
server_key_iv: "41fc8196bf7155b09f56018467cec3ed"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.534814 1816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "95aa46670b7842b98db3ae3999e76a97"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "ef46ee9281ddc75e86781d90797564e2"
server_key_iv: "41fc8196bf7155b09f56018467cec3ed"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.536078 1816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:10:31.536751 1840 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.536912 1816 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:10:31.537001 1816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "95aa46670b7842b98db3ae3999e76a97"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "ef46ee9281ddc75e86781d90797564e2"
server_key_iv: "41fc8196bf7155b09f56018467cec3ed"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.537060 1816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:31.568132 1816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:31.569880 1816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:31.570027 1816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:31.570233 1816 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:31.570534 1816 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:31.570568 1816 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.570598 1816 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:31.570622 1816 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.576318 1816 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:44529
I20260808 05:10:31.576398 2021 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:44529 every 8 connection(s)
I20260808 05:10:31.576704 1816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:31.584897 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.577366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:44763 (local address 127.12.251.62:39893)
0808 05:10:31.577414 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.577416 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.577629 (+ 213us) server_negotiation.cc:407] Connection header received
0808 05:10:31.578092 (+ 463us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.578093 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.578104 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.578154 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:31.579008 (+ 854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.579508 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.580402 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.580580 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.580622 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.582590 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:31.582591 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:31.582592 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:31.582600 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:31.583669 (+ 1069us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.584027 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.584028 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.584028 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.584084 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.584299 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.584300 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.584300 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.584412 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:31.584469 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.584720 (+ 251us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.584799 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:10:31.585053 2024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.577361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:44763)
0808 05:10:31.577512 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.577549 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.578019 (+ 470us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.578207 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.578210 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.578754 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:31.578942 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.578947 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.579571 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.579571 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.580344 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.580346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.580631 (+ 285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.580631 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.580731 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.581126 (+ 395us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:31.581134 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:31.582500 (+ 1366us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:31.583744 (+ 1244us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:31.583751 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:31.583753 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:31.583961 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:31.584136 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:31.584137 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:31.584138 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:31.584243 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:31.584471 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:31.584478 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:31.584605 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.584692 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.584846 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260808 05:10:31.585511 2022 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39893
I20260808 05:10:31.585600 2022 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:31.585744 2022 heartbeater.cc:511] Master 127.12.251.62:39893 requested a full tablet report, sending...
I20260808 05:10:31.585960 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 1816
I20260808 05:10:31.586076 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:10:31.586110 1305 ts_manager.cc:194] Registered new tserver with Master: 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529)
I20260808 05:10:31.586256 13292 external_mini_cluster.cc:1428] Setting key c56cc4b8abf7ed74ac5237ba535f4ec8
I20260808 05:10:31.586571 1305 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:44763
I20260808 05:10:31.587180 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:10:31.593467 1369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.588414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43616 (local address 127.12.251.62:39893)
0808 05:10:31.588459 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.588461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.588565 (+ 104us) server_negotiation.cc:407] Connection header received
0808 05:10:31.588612 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.588613 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.588620 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.588664 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:31.589155 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.589662 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.590348 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.590522 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.590570 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.591548 (+ 978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:31.591549 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:31.591549 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:31.591555 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:31.592587 (+ 1032us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.592863 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.592863 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.592864 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.592901 (+ 37us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:31.593022 (+ 121us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:31.593022 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:31.593022 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:31.593149 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:31.593251 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.593351 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.593409 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:10:31.594754 1305 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43616:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:10:31.596403 1305 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:10:31.601969 2037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.598559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38222 (local address 127.12.251.2:46061)
0808 05:10:31.598740 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.598746 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.598757 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:10:31.598801 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.598804 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.598819 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.598896 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:31.599058 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.599871 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.600958 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.601573 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.601639 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.601697 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.601855 (+ 158us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.601893 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
I20260808 05:10:31.601961 2034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.598433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46061 (local address 127.0.0.1:38222)
0808 05:10:31.598602 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.598639 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.598701 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.598899 (+ 198us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.598902 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.598904 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:31.598969 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.598971 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.599974 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.599975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.600872 (+ 897us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.600874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.601658 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.601659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.601759 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.601773 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.601834 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.601889 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":73,"threads_started":1}
I20260808 05:10:31.602684 1706 tablet_service.cc:1467] Processing CreateTablet for tablet 2affe825c63c44a59d19dd5fa108e2c7 (DEFAULT_TABLE table=test-table [id=1e9ecc923cd8497ca223c20ac0d4c7a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:31.602973 2040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.598434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36285 (local address 127.0.0.1:37276)
0808 05:10:31.598735 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.598746 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.598802 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.599222 (+ 420us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.599223 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.599225 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:31.599270 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.599272 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.600602 (+ 1330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.600603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.601627 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.601629 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.602746 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.602747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.602805 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.602809 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.602854 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.602893 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":288,"mutex_wait_us":4,"spinlock_wait_cycles":768,"thread_start_us":74,"threads_started":1}
I20260808 05:10:31.603061 1706 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2affe825c63c44a59d19dd5fa108e2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:31.603223 2038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.598559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.12.251.1:36285)
0808 05:10:31.599050 (+ 491us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.599054 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.599064 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:10:31.599104 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.599106 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.599122 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.599345 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:31.599420 (+ 75us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.600503 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.601722 (+ 1219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.602673 (+ 951us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.602735 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.602788 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.602923 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.602967 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":79,"threads_started":1}
I20260808 05:10:31.603466 2035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.598643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:44529 (local address 127.0.0.1:54448)
0808 05:10:31.598784 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.598791 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.598827 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.599299 (+ 472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.599300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.599302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:31.599329 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.599330 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.601296 (+ 1966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.601297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.602356 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.602359 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.603228 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.603229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.603314 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.603318 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.603367 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.603402 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":36,"threads_started":1}
I20260808 05:10:31.603499 2041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.598784 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54448 (local address 127.12.251.3:44529)
0808 05:10:31.599111 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.599114 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.599122 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:10:31.599155 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.599157 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.599169 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.599233 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:31.599397 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.600494 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.602449 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.603130 (+ 681us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.603204 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.603257 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.603383 (+ 126us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.603422 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295,"thread_start_us":88,"threads_started":1}
I20260808 05:10:31.603984 1496 tablet_service.cc:1467] Processing CreateTablet for tablet 2affe825c63c44a59d19dd5fa108e2c7 (DEFAULT_TABLE table=test-table [id=1e9ecc923cd8497ca223c20ac0d4c7a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:31.604269 1496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2affe825c63c44a59d19dd5fa108e2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:31.605926 1911 tablet_service.cc:1467] Processing CreateTablet for tablet 2affe825c63c44a59d19dd5fa108e2c7 (DEFAULT_TABLE table=test-table [id=1e9ecc923cd8497ca223c20ac0d4c7a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:31.606027 2042 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Bootstrap starting.
I20260808 05:10:31.606240 1911 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2affe825c63c44a59d19dd5fa108e2c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:31.606549 2042 tablet_bootstrap.cc:654] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:31.606937 2042 log.cc:824] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:31.607111 2044 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap starting.
I20260808 05:10:31.607781 2044 tablet_bootstrap.cc:654] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:31.607859 2042 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: No bootstrap required, opened a new log
I20260808 05:10:31.607921 2042 ts_tablet_manager.cc:1397] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:10:31.608333 2044 log.cc:824] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:31.609110 2044 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: No bootstrap required, opened a new log
I20260808 05:10:31.609185 2044 ts_tablet_manager.cc:1397] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:10:31.609376 2049 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Bootstrap starting.
I20260808 05:10:31.609866 2049 tablet_bootstrap.cc:654] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:31.609843 2042 raft_consensus.cc:348] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.610029 2042 raft_consensus.cc:374] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:31.610067 2042 raft_consensus.cc:729] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c2eb2e9d614abe9a5ac9975ecaf4ac, State: Initialized, Role: FOLLOWER
I20260808 05:10:31.610216 2042 consensus_queue.cc:260] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.610376 2049 log.cc:824] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:31.610491 2042 ts_tablet_manager.cc:1428] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:10:31.610546 1808 heartbeater.cc:503] Master 127.12.251.62:39893 was elected leader, sending a full tablet report...
I20260808 05:10:31.611085 2044 raft_consensus.cc:348] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.611248 2049 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: No bootstrap required, opened a new log
I20260808 05:10:31.611251 2044 raft_consensus.cc:374] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:31.611289 2044 raft_consensus.cc:729] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8bbc03c7304e1f8963bd5b39c54d68, State: Initialized, Role: FOLLOWER
I20260808 05:10:31.611318 2049 ts_tablet_manager.cc:1397] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:10:31.611449 2044 consensus_queue.cc:260] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.611716 2044 ts_tablet_manager.cc:1428] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260808 05:10:31.611963 1587 heartbeater.cc:503] Master 127.12.251.62:39893 was elected leader, sending a full tablet report...
I20260808 05:10:31.612915 2049 raft_consensus.cc:348] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.613039 2049 raft_consensus.cc:374] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:31.613059 2049 raft_consensus.cc:729] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95aa46670b7842b98db3ae3999e76a97, State: Initialized, Role: FOLLOWER
I20260808 05:10:31.613140 2049 consensus_queue.cc:260] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.613405 2049 ts_tablet_manager.cc:1428] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:10:31.613413 2022 heartbeater.cc:503] Master 127.12.251.62:39893 was elected leader, sending a full tablet report...
W20260808 05:10:31.660852 1810 tablet.cc:2369] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:10:31.726713 2053 raft_consensus.cc:482] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:31.726840 2053 raft_consensus.cc:504] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.727231 2053 leader_election.cc:288] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061), af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285)
I20260808 05:10:31.730993 2038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.727539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:48645 (local address 127.12.251.1:36285)
0808 05:10:31.727581 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.727582 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.727722 (+ 140us) server_negotiation.cc:407] Connection header received
0808 05:10:31.727753 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.727754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.727764 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.727810 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:31.727934 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.728624 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.730032 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.730625 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.730700 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.730708 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.730870 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.730907 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:10:31.730983 2037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.727494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:58303 (local address 127.12.251.2:46061)
0808 05:10:31.727540 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.727542 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.727563 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:10:31.727596 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.727597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.727609 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.727664 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:31.727841 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.728579 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.730032 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.730625 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.730699 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.730708 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.730870 (+ 162us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.730907 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:10:31.731020 2024 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.727419 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46061 (local address 127.12.251.3:58303)
0808 05:10:31.727475 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.727487 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.727534 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.727689 (+ 155us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.727690 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.727692 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:31.727767 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.727768 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.728662 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.728663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.729953 (+ 1290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.729954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.730707 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.730708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.730810 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.730812 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.730860 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.730907 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":44}
I20260808 05:10:31.731027 2054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.727423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36285 (local address 127.12.251.3:48645)
0808 05:10:31.727644 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.727653 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:31.727710 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:31.727828 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:31.727828 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:31.727830 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:31.727880 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.727881 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.728689 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.728690 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.729949 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:31.729953 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.730707 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.730708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:31.730805 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.730810 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:10:31.730860 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:10:31.730906 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"mutex_wait_us":85,"thread_start_us":110,"threads_started":1}
I20260808 05:10:31.731423 1733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affe825c63c44a59d19dd5fa108e2c7" candidate_uuid: "95aa46670b7842b98db3ae3999e76a97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" is_pre_election: true
I20260808 05:10:31.731477 1525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affe825c63c44a59d19dd5fa108e2c7" candidate_uuid: "95aa46670b7842b98db3ae3999e76a97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" is_pre_election: true
I20260808 05:10:31.731573 1733 raft_consensus.cc:2454] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95aa46670b7842b98db3ae3999e76a97 in term 0.
I20260808 05:10:31.731621 1525 raft_consensus.cc:2454] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95aa46670b7842b98db3ae3999e76a97 in term 0.
I20260808 05:10:31.731825 1844 leader_election.cc:302] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c2eb2e9d614abe9a5ac9975ecaf4ac, 95aa46670b7842b98db3ae3999e76a97; no voters:
I20260808 05:10:31.731953 2053 raft_consensus.cc:2781] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:10:31.732018 2053 raft_consensus.cc:482] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:10:31.732039 2053 raft_consensus.cc:3037] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:31.732713 2053 raft_consensus.cc:504] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.732828 2053 leader_election.cc:288] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [CANDIDATE]: Term 1 election: Requested vote from peers 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061), af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285)
I20260808 05:10:31.732990 1733 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affe825c63c44a59d19dd5fa108e2c7" candidate_uuid: "95aa46670b7842b98db3ae3999e76a97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac"
I20260808 05:10:31.733011 1525 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2affe825c63c44a59d19dd5fa108e2c7" candidate_uuid: "95aa46670b7842b98db3ae3999e76a97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8bbc03c7304e1f8963bd5b39c54d68"
I20260808 05:10:31.733062 1733 raft_consensus.cc:3037] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:31.733078 1525 raft_consensus.cc:3037] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:31.733855 1733 raft_consensus.cc:2454] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95aa46670b7842b98db3ae3999e76a97 in term 1.
I20260808 05:10:31.733912 1525 raft_consensus.cc:2454] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95aa46670b7842b98db3ae3999e76a97 in term 1.
I20260808 05:10:31.734076 1842 leader_election.cc:302] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 95aa46670b7842b98db3ae3999e76a97, af8bbc03c7304e1f8963bd5b39c54d68; no voters:
I20260808 05:10:31.734165 2053 raft_consensus.cc:2781] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:31.734316 2053 raft_consensus.cc:686] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 1 LEADER]: Becoming Leader. State: Replica: 95aa46670b7842b98db3ae3999e76a97, State: Running, Role: LEADER
I20260808 05:10:31.734400 2053 consensus_queue.cc:237] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:31.735308 1305 catalog_manager.cc:5495] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3). New cstate: current_term: 1 leader_uuid: "95aa46670b7842b98db3ae3999e76a97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } health_report { overall_health: HEALTHY } } }
I20260808 05:10:31.748358 2041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.746296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54462 (local address 127.12.251.3:44529)
0808 05:10:31.746347 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:31.746348 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:31.746357 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:10:31.746430 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:31.746431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:31.746452 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:31.746517 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:10:31.746619 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.747074 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.747779 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:31.747959 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:31.748015 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:31.748107 (+ 92us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:10:31.748199 (+ 92us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:10:31.748256 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:31.748267 (+ 11us) server_negotiation.cc:299] Negotiation successful
0808 05:10:31.748283 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:10:31.750151 1733 raft_consensus.cc:1261] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 FOLLOWER]: Refusing update from remote peer 95aa46670b7842b98db3ae3999e76a97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:31.750151 1525 raft_consensus.cc:1261] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Refusing update from remote peer 95aa46670b7842b98db3ae3999e76a97: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:31.750517 2055 consensus_queue.cc:1035] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:31.750658 2053 consensus_queue.cc:1035] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:31.755517 1305 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:31.755605 1305 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43616:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:31.756313 1305 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Sending DeleteTablet for 3 replicas of tablet 2affe825c63c44a59d19dd5fa108e2c7
I20260808 05:10:31.756657 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 1401
I20260808 05:10:31.756659 1496 tablet_service.cc:1514] Processing DeleteTablet for tablet 2affe825c63c44a59d19dd5fa108e2c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:31 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:37276
I20260808 05:10:31.756734 1911 tablet_service.cc:1514] Processing DeleteTablet for tablet 2affe825c63c44a59d19dd5fa108e2c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:31 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:54448
I20260808 05:10:31.763914 2079 tablet_replica.cc:330] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: stopping tablet replica
I20260808 05:10:31.764046 2079 raft_consensus.cc:2229] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:10:31.757171 1706 tablet_service.cc:1514] Processing DeleteTablet for tablet 2affe825c63c44a59d19dd5fa108e2c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:31 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:38222
I20260808 05:10:31.764196 2079 raft_consensus.cc:2258] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:31.764349 2081 tablet_replica.cc:330] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: stopping tablet replica
I20260808 05:10:31.764536 2081 raft_consensus.cc:2229] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:10:31.764739 2081 raft_consensus.cc:2258] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:31.765528 2079 ts_tablet_manager.cc:1905] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:31.765560 2081 ts_tablet_manager.cc:1905] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:31.767197 2079 ts_tablet_manager.cc:1918] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:31.767275 2079 log.cc:1196] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/2affe825c63c44a59d19dd5fa108e2c7
I20260808 05:10:31.767208 2081 ts_tablet_manager.cc:1918] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:31.767413 2081 log.cc:1196] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/2affe825c63c44a59d19dd5fa108e2c7
I20260808 05:10:31.767560 2079 ts_tablet_manager.cc:1939] T 2affe825c63c44a59d19dd5fa108e2c7 P 95aa46670b7842b98db3ae3999e76a97: Deleting consensus metadata
I20260808 05:10:31.767774 2081 ts_tablet_manager.cc:1939] T 2affe825c63c44a59d19dd5fa108e2c7 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Deleting consensus metadata
I20260808 05:10:31.767983 1280 catalog_manager.cc:4841] TS 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529): tablet 2affe825c63c44a59d19dd5fa108e2c7 (table test-table [id=1e9ecc923cd8497ca223c20ac0d4c7a8]) successfully deleted
I20260808 05:10:31.768321 1280 catalog_manager.cc:4841] TS 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061): tablet 2affe825c63c44a59d19dd5fa108e2c7 (table test-table [id=1e9ecc923cd8497ca223c20ac0d4c7a8]) successfully deleted
W20260808 05:10:31.770147 1279 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:36285 (error 108)
I20260808 05:10:31.770308 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 1593
I20260808 05:10:31.778807 2035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:31.778628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36285 (local address 127.0.0.1:37282)
0808 05:10:31.778705 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:31.778768 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260808 05:10:31.778955 1279 catalog_manager.cc:4584] TS af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2affe825c63c44a59d19dd5fa108e2c7: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36285: connect: Connection refused (error 111)
I20260808 05:10:31.781591 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 1816
I20260808 05:10:31.790357 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 1253
I20260808 05:10:31.799235 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39893
--webserver_interface=127.12.251.62
--webserver_port=45865
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:39893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:31.881913 2085 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:31.882122 2085 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:31.882154 2085 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:31.883298 2085 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:31.883342 2085 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:31.883361 2085 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:31.883378 2085 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:31.883391 2085 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:31.884842 2085 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:39893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=45865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2085
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:31.885082 2085 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:31.885361 2085 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:31.897491 2096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.897552 2098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:31.897481 2095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:31.897593 2085 server_base.cc:1034] running on GCE node
I20260808 05:10:31.898065 2085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:31.898375 2085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:31.899529 2085 hybrid_clock.cc:648] HybridClock initialized: now 1786165831899507 us; error 33 us; skew 500 ppm
Aug 08 05:10:31 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165831, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:31.905886 2085 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:31.906368 2085 webserver.cc:460] Webserver started at http://127.12.251.62:45865/ using document root <none> and password file <none>
I20260808 05:10:31.906571 2085 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:31.906626 2085 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:31.908062 2085 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:31.908641 2106 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.908800 2085 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:31.908891 2085 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "a0da6326dfc84272a39099f55fd7cef5"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "203a43205b8534cf587cb201eae6ccef"
server_key_iv: "21e2399e949870dadda0971c34043c97"
server_key_version: "encryptionkey@0"
I20260808 05:10:31.909336 2085 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:31.919704 2085 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:31.921797 2085 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:31.921905 2085 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:31.925769 2085 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:39893
I20260808 05:10:31.925815 2186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:39893 every 8 connection(s)
I20260808 05:10:31.926183 2085 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:31.927815 2187 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:10:31.928479 2187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Bootstrap starting.
I20260808 05:10:31.934404 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 2085
I20260808 05:10:31.934667 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:36285
--local_ip_for_outbound_sockets=127.12.251.1
--tserver_master_addrs=127.12.251.62:39893
--webserver_port=41711
--webserver_interface=127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:31.937184 2187 log.cc:824] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:31.939029 2187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:10:31.939311 2187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Bootstrap complete.
I20260808 05:10:31.941642 2187 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.941866 2187 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0da6326dfc84272a39099f55fd7cef5, State: Initialized, Role: FOLLOWER
I20260808 05:10:31.942010 2187 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.942077 2187 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:10:31.942123 2187 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:10:31.942170 2187 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:10:31.943168 2187 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.943257 2187 leader_election.cc:302] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0da6326dfc84272a39099f55fd7cef5; no voters:
I20260808 05:10:31.943414 2187 leader_election.cc:288] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:10:31.943464 2191 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:10:31.943630 2191 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 LEADER]: Becoming Leader. State: Replica: a0da6326dfc84272a39099f55fd7cef5, State: Running, Role: LEADER
I20260808 05:10:31.943696 2187 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:31.943781 2191 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:31.944191 2191 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0da6326dfc84272a39099f55fd7cef5. Latest consensus state: current_term: 2 leader_uuid: "a0da6326dfc84272a39099f55fd7cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } } }
I20260808 05:10:31.944291 2191 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:31.944474 2194 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "a0da6326dfc84272a39099f55fd7cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } } }
I20260808 05:10:31.944554 2194 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:31.945583 2212 catalog_manager.cc:1259] Loaded cluster ID: 24c2894de6894ad9bf6cced604c6d144
I20260808 05:10:31.945623 2212 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: loading cluster ID for follower catalog manager: success
W20260808 05:10:31.945801 2212 catalog_manager.cc:1576] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260808 05:10:31.945833 2212 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260808 05:10:31.945863 2203 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:31.946198 2203 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:10:31.946270 2203 catalog_manager.cc:1259] Loaded cluster ID: 24c2894de6894ad9bf6cced604c6d144
I20260808 05:10:31.946302 2203 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:10:31.946444 2203 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260808 05:10:31.949132 2203 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260808 05:10:31.954201 2203 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:10:31.954404 2203 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Loaded TSK: 0
I20260808 05:10:31.954610 2203 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:10:32.039527 2189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:32.039719 2189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:32.039740 2189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:32.040872 2189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:32.040915 2189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:32.040939 2189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:10:32.042351 2189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:36285
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=41711
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:32.042580 2189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:32.042785 2189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:32.047617 2228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.047570 2224 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.047573 2223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.047838 2189 server_base.cc:1034] running on GCE node
I20260808 05:10:32.048094 2189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:32.048363 2189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:32.049546 2189 hybrid_clock.cc:648] HybridClock initialized: now 1786165832049530 us; error 27 us; skew 500 ppm
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:32.052515 2189 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:10:32.053047 2189 webserver.cc:460] Webserver started at http://127.12.251.1:41711/ using document root <none> and password file <none>
I20260808 05:10:32.053345 2189 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:32.053445 2189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:32.055162 2189 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:10:32.055970 2244 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.056156 2189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:10:32.056254 2189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "af8bbc03c7304e1f8963bd5b39c54d68"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "953908be1dc223de59184548bfe8fd38"
server_key_iv: "13c199e843a3ae9206ea377ad3c29ab1"
server_key_version: "encryptionkey@0"
I20260808 05:10:32.056684 2189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:32.074695 2189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:32.077108 2189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:32.077317 2189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:32.077589 2189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:32.078063 2254 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:10:32.079470 2189 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:10:32.079533 2189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:10:32.079568 2189 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:10:32.080421 2189 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:10:32.080469 2189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 05:10:32.080544 2254 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap starting.
I20260808 05:10:32.087324 2189 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:36285
I20260808 05:10:32.087531 2423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:36285 every 8 connection(s)
I20260808 05:10:32.087821 2189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:10:32.090679 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 2189
I20260808 05:10:32.090965 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:46061
--local_ip_for_outbound_sockets=127.12.251.2
--tserver_master_addrs=127.12.251.62:39893
--webserver_port=38491
--webserver_interface=127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:32.091583 2254 log.cc:824] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:32.094106 2254 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:10:32.094384 2254 tablet_bootstrap.cc:492] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap complete.
I20260808 05:10:32.095666 2254 ts_tablet_manager.cc:1397] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.014s
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:32.096740 2254 raft_consensus.cc:348] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:32.097048 2254 raft_consensus.cc:729] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8bbc03c7304e1f8963bd5b39c54d68, State: Initialized, Role: FOLLOWER
I20260808 05:10:32.097229 2254 consensus_queue.cc:260] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } } peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } }
I20260808 05:10:32.097508 2254 ts_tablet_manager.cc:1428] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:10:32.101305 2426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.088546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:53255)
0808 05:10:32.088730 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.088780 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.089460 (+ 680us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.089946 (+ 486us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.089951 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.090382 (+ 431us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:32.090732 (+ 350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.090741 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.092470 (+ 1729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.092471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.093735 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.093737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.094764 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.094765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.094915 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.095492 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:32.095503 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:32.097387 (+ 1884us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:32.099488 (+ 2101us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:32.099497 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:32.099499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:32.099805 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:32.100082 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:32.100082 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:32.100082 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:32.100223 (+ 141us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:32.100619 (+ 396us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:32.100626 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:32.100783 (+ 157us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.100895 (+ 112us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.101062 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260808 05:10:32.101315 2427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.088682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:53255 (local address 127.12.251.62:39893)
0808 05:10:32.088874 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.088883 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.088925 (+ 42us) server_negotiation.cc:407] Connection header received
0808 05:10:32.089676 (+ 751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.089684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.089738 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.089869 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:32.090897 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.092342 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.093843 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.094637 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.095200 (+ 563us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.097511 (+ 2311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:32.097515 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:32.097515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:32.097528 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:32.099389 (+ 1861us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.099901 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.099904 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.099905 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.100017 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.100289 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.100290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.100290 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.100554 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:32.100624 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.100958 (+ 334us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.101090 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":119,"threads_started":1}
I20260808 05:10:32.102445 2424 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39893
I20260808 05:10:32.102545 2424 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:32.102720 2424 heartbeater.cc:511] Master 127.12.251.62:39893 requested a full tablet report, sending...
I20260808 05:10:32.103498 2137 ts_manager.cc:194] Registered new tserver with Master: af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285)
I20260808 05:10:32.104722 2137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:53255
I20260808 05:10:32.105690 2424 heartbeater.cc:503] Master 127.12.251.62:39893 was elected leader, sending a full tablet report...
I20260808 05:10:32.113030 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.105431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37298 (local address 127.12.251.1:36285)
0808 05:10:32.109557 (+ 4126us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.109561 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.109567 (+ 6us) server_negotiation.cc:407] Connection header received
0808 05:10:32.109596 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.109598 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.109609 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.109663 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:32.109873 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.110546 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.112111 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.112681 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.112738 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.112775 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.112934 (+ 159us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.112976 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4098,"thread_start_us":66,"threads_started":1}
I20260808 05:10:32.113037 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.105158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36285 (local address 127.0.0.1:37298)
0808 05:10:32.109356 (+ 4198us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.109388 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.109456 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.109701 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.109705 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.109708 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:32.109774 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.109776 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.110617 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.110618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.112031 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.112034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.112745 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.112746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.112824 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.112839 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.112906 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.112957 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4168,"thread_start_us":99,"threads_started":1}
I20260808 05:10:32.113474 2319 tablet_service.cc:1514] Processing DeleteTablet for tablet 2affe825c63c44a59d19dd5fa108e2c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:31 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:37298
I20260808 05:10:32.113946 2436 tablet_replica.cc:330] stopping tablet replica
I20260808 05:10:32.114044 2436 raft_consensus.cc:2229] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:10:32.114113 2436 raft_consensus.cc:2258] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:32.114389 2436 ts_tablet_manager.cc:1905] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:32.116261 2436 ts_tablet_manager.cc:1918] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:32.116338 2436 log.cc:1196] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/2affe825c63c44a59d19dd5fa108e2c7
I20260808 05:10:32.116555 2436 ts_tablet_manager.cc:1939] T 2affe825c63c44a59d19dd5fa108e2c7 P af8bbc03c7304e1f8963bd5b39c54d68: Deleting consensus metadata
I20260808 05:10:32.117028 2108 catalog_manager.cc:4841] TS af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285): tablet 2affe825c63c44a59d19dd5fa108e2c7 (table test-table [id=1e9ecc923cd8497ca223c20ac0d4c7a8]) successfully deleted
W20260808 05:10:32.180490 2429 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:32.180691 2429 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:32.180720 2429 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:32.181929 2429 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:32.181973 2429 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:32.181999 2429 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:10:32.183431 2429 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:46061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=38491
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2429
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:32.183657 2429 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:32.183866 2429 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:32.188700 2452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.188827 2429 server_base.cc:1034] running on GCE node
W20260808 05:10:32.188771 2444 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.188834 2449 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.189237 2429 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:32.189484 2429 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:32.190624 2429 hybrid_clock.cc:648] HybridClock initialized: now 1786165832190586 us; error 49 us; skew 500 ppm
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:32.192991 2429 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:10:32.193439 2429 webserver.cc:460] Webserver started at http://127.12.251.2:38491/ using document root <none> and password file <none>
I20260808 05:10:32.193636 2429 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:32.193686 2429 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:32.194916 2429 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:32.195381 2460 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.195528 2429 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.195616 2429 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "044db0bb03a2e83a21fadaf843e538cc"
server_key_iv: "eae5c652256acb39d9be119072bf379b"
server_key_version: "encryptionkey@0"
I20260808 05:10:32.195928 2429 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:32.210510 2429 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:32.212406 2429 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:32.212549 2429 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:32.212771 2429 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:32.213075 2429 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:32.213109 2429 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.213132 2429 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:32.213155 2429 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.218528 2429 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:46061
I20260808 05:10:32.218600 2626 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:46061 every 8 connection(s)
I20260808 05:10:32.218896 2429 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:10:32.220911 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 2429
I20260808 05:10:32.221210 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:44529
--local_ip_for_outbound_sockets=127.12.251.3
--tserver_master_addrs=127.12.251.62:39893
--webserver_port=45025
--webserver_interface=127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:32.229877 2427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.219597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:43865 (local address 127.12.251.62:39893)
0808 05:10:32.219659 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.219661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.219851 (+ 190us) server_negotiation.cc:407] Connection header received
0808 05:10:32.220346 (+ 495us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.220347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.220356 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.220397 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:32.221520 (+ 1123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.222033 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.223266 (+ 1233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.223555 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.223619 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.226925 (+ 3306us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:32.226927 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:32.226928 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:32.226937 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:32.228476 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.228882 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.228884 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.228884 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.228949 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.229168 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.229169 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.229169 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.229333 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:32.229404 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.229688 (+ 284us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.229780 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:10:32.229920 2629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.219562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:43865)
0808 05:10:32.219733 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.219774 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.220251 (+ 477us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.220456 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.220459 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.221132 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:32.221432 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.221439 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.222121 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.222122 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.223187 (+ 1065us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.223190 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.223629 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.223630 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.223737 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.225332 (+ 1595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:32.225341 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:32.226828 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:32.228565 (+ 1737us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:32.228572 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:32.228574 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:32.228806 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:32.229012 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:32.229013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:32.229013 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:32.229115 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:32.229402 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:32.229408 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:32.229534 (+ 126us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.229626 (+ 92us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.229752 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":87,"threads_started":1}
I20260808 05:10:32.230443 2627 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39893
I20260808 05:10:32.230547 2627 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:32.230718 2627 heartbeater.cc:511] Master 127.12.251.62:39893 requested a full tablet report, sending...
I20260808 05:10:32.231112 2137 ts_manager.cc:194] Registered new tserver with Master: 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061)
I20260808 05:10:32.231623 2137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:43865
W20260808 05:10:32.304105 2630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:32.304291 2630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:32.304312 2630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:32.305397 2630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:32.305429 2630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:32.305454 2630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:10:32.307157 2630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:44529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=45025
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:32.307396 2630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:32.307591 2630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:10:32.312338 2630 server_base.cc:1034] running on GCE node
W20260808 05:10:32.312319 2640 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.312288 2642 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.312287 2639 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.312711 2630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:32.312971 2630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:32.314107 2630 hybrid_clock.cc:648] HybridClock initialized: now 1786165832314093 us; error 30 us; skew 500 ppm
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:32.316404 2630 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:10:32.316861 2630 webserver.cc:460] Webserver started at http://127.12.251.3:45025/ using document root <none> and password file <none>
I20260808 05:10:32.317101 2630 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:32.317157 2630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:32.318440 2630 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:32.318953 2652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.319103 2630 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.319178 2630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "95aa46670b7842b98db3ae3999e76a97"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "ef46ee9281ddc75e86781d90797564e2"
server_key_iv: "41fc8196bf7155b09f56018467cec3ed"
server_key_version: "encryptionkey@0"
I20260808 05:10:32.319505 2630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:32.328552 2630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:32.330228 2630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:32.330345 2630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:32.330541 2630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:32.330899 2630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:32.330945 2630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.330971 2630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:32.330997 2630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.336767 2630 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:44529
I20260808 05:10:32.336831 2820 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:44529 every 8 connection(s)
I20260808 05:10:32.337133 2630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:32.345980 2427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.337811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:52883 (local address 127.12.251.62:39893)
0808 05:10:32.337871 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.337873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.338073 (+ 200us) server_negotiation.cc:407] Connection header received
0808 05:10:32.338581 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.338582 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.338594 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.338647 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:32.339561 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.340042 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.341200 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.341450 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.341512 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.343473 (+ 1961us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:32.343474 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:32.343475 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:32.343481 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:32.344736 (+ 1255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.345124 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.345125 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.345126 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.345180 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.345453 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.345454 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.345454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.345559 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:32.345609 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.345828 (+ 219us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.345914 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:10:32.346119 2825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.337796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:52883)
0808 05:10:32.337963 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.337996 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.338465 (+ 469us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.338734 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.338738 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.339279 (+ 541us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:32.339465 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.339470 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.340124 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.340125 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.341097 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.341100 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.341530 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.341531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.341662 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.342051 (+ 389us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:32.342058 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:32.343393 (+ 1335us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:32.344820 (+ 1427us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:32.344827 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:32.344828 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:32.345058 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:32.345260 (+ 202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:32.345261 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:32.345261 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:32.345401 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:32.345614 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:32.345619 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:32.345731 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.345809 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.345931 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":75,"threads_started":1}
I20260808 05:10:32.346623 2822 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39893
I20260808 05:10:32.346719 2822 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:32.346902 2822 heartbeater.cc:511] Master 127.12.251.62:39893 requested a full tablet report, sending...
I20260808 05:10:32.347046 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 2630
I20260808 05:10:32.347523 2137 ts_manager.cc:194] Registered new tserver with Master: 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529)
I20260808 05:10:32.347889 2137 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:52883
I20260808 05:10:32.352682 2427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.347405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43630 (local address 127.12.251.62:39893)
0808 05:10:32.347440 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.347442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.347570 (+ 128us) server_negotiation.cc:407] Connection header received
0808 05:10:32.347630 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.347631 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.347640 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.347683 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:32.348242 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.348697 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.349475 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.349656 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.349707 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.350743 (+ 1036us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:32.350744 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:32.350744 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:32.350751 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:32.351705 (+ 954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.352012 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.352013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.352013 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.352064 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:32.352228 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:32.352229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:32.352229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:32.352327 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:32.352491 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.352526 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.352595 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 05:10:32.353545 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:10:32.356148 2427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.353865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43644 (local address 127.12.251.62:39893)
0808 05:10:32.353908 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.353910 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.354045 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:10:32.354098 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.354098 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.354128 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.354182 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:10:32.354261 (+ 79us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.354698 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.355464 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.355639 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.355691 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.355894 (+ 203us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:10:32.355985 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:10:32.356046 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.356076 (+ 30us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.356091 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:10:32.356478 2137 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:43644:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:10:32.358139 2137 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:10:32.360160 2319 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec50d0918d141cdbee517b23b544636 (DEFAULT_TABLE table=test-table [id=418a946c6a1b4abb9822910961d6b0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:32.360356 2319 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec50d0918d141cdbee517b23b544636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:32.361827 2254 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap starting.
I20260808 05:10:32.362147 2254 tablet_bootstrap.cc:654] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:32.362754 2254 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: No bootstrap required, opened a new log
I20260808 05:10:32.362804 2254 ts_tablet_manager.cc:1397] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:10:32.362901 2254 raft_consensus.cc:348] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.362975 2254 raft_consensus.cc:374] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:32.363024 2254 raft_consensus.cc:729] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8bbc03c7304e1f8963bd5b39c54d68, State: Initialized, Role: FOLLOWER
I20260808 05:10:32.363071 2254 consensus_queue.cc:260] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.363173 2254 ts_tablet_manager.cc:1428] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.364204 2830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.359998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46061 (local address 127.0.0.1:38226)
0808 05:10:32.360103 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.360111 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.360149 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.360639 (+ 490us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.360640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.360643 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:32.360684 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.360685 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.362017 (+ 1332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.362018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.362989 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.362992 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.363978 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.363979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.364038 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.364041 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.364092 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.364130 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":72,"threads_started":1}
I20260808 05:10:32.364230 2832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.360188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38226 (local address 127.12.251.2:46061)
0808 05:10:32.360446 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.360452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.360466 (+ 14us) server_negotiation.cc:407] Connection header received
0808 05:10:32.360517 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.360519 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.360536 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.360628 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:32.360743 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.361912 (+ 1169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.363097 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.363816 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.363862 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.363920 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.364134 (+ 214us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.364171 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":92,"threads_started":1}
I20260808 05:10:32.364794 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.359902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:44529 (local address 127.0.0.1:54474)
0808 05:10:32.359935 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.359953 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.360000 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.361663 (+ 1663us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.361664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.361666 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:32.361705 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.361706 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.362733 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.362734 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.363724 (+ 990us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.363727 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.364624 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.364625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.364674 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.364678 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.364716 (+ 38us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.364750 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18}
I20260808 05:10:32.364850 2831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.359994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54474 (local address 127.12.251.3:44529)
0808 05:10:32.361360 (+ 1366us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.361365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.361375 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:10:32.361414 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.361416 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.361429 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.361650 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:32.361807 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.362638 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.363838 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.364555 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.364627 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.364682 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.364739 (+ 57us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.364777 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1325,"thread_start_us":81,"threads_started":1}
I20260808 05:10:32.365003 2530 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec50d0918d141cdbee517b23b544636 (DEFAULT_TABLE table=test-table [id=418a946c6a1b4abb9822910961d6b0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:32.365348 2530 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec50d0918d141cdbee517b23b544636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:32.365567 2730 tablet_service.cc:1467] Processing CreateTablet for tablet 4ec50d0918d141cdbee517b23b544636 (DEFAULT_TABLE table=test-table [id=418a946c6a1b4abb9822910961d6b0b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:32.365904 2730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4ec50d0918d141cdbee517b23b544636. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:32.368964 2834 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Bootstrap starting.
I20260808 05:10:32.369377 2836 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Bootstrap starting.
I20260808 05:10:32.369625 2834 tablet_bootstrap.cc:654] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:32.369931 2836 tablet_bootstrap.cc:654] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:32.370096 2834 log.cc:824] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:32.370366 2836 log.cc:824] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:32.370805 2834 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: No bootstrap required, opened a new log
I20260808 05:10:32.370883 2834 ts_tablet_manager.cc:1397] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260808 05:10:32.371068 2836 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: No bootstrap required, opened a new log
I20260808 05:10:32.371135 2836 ts_tablet_manager.cc:1397] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:10:32.373090 2834 raft_consensus.cc:348] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.373292 2834 raft_consensus.cc:374] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:32.373343 2834 raft_consensus.cc:729] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47c2eb2e9d614abe9a5ac9975ecaf4ac, State: Initialized, Role: FOLLOWER
I20260808 05:10:32.373302 2836 raft_consensus.cc:348] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.373442 2836 raft_consensus.cc:374] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:32.373481 2836 raft_consensus.cc:729] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95aa46670b7842b98db3ae3999e76a97, State: Initialized, Role: FOLLOWER
I20260808 05:10:32.373464 2834 consensus_queue.cc:260] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.373587 2836 consensus_queue.cc:260] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.373776 2834 ts_tablet_manager.cc:1428] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260808 05:10:32.373799 2627 heartbeater.cc:503] Master 127.12.251.62:39893 was elected leader, sending a full tablet report...
I20260808 05:10:32.373829 2836 ts_tablet_manager.cc:1428] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:10:32.373939 2822 heartbeater.cc:503] Master 127.12.251.62:39893 was elected leader, sending a full tablet report...
I20260808 05:10:32.418898 2840 raft_consensus.cc:482] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:32.419035 2840 raft_consensus.cc:504] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.419433 2840 leader_election.cc:288] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529), af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285)
I20260808 05:10:32.423023 2831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.419672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:47061 (local address 127.12.251.3:44529)
0808 05:10:32.419717 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.419719 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.419728 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:10:32.419758 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.419759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.419769 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.419814 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:32.419976 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.420729 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.422124 (+ 1395us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.422681 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.422884 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.422892 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.422916 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.422956 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:10:32.423048 2434 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.419671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44909 (local address 127.12.251.1:36285)
0808 05:10:32.419721 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.419722 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.419866 (+ 144us) server_negotiation.cc:407] Connection header received
0808 05:10:32.419895 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.419896 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.419904 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.419965 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:32.420093 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.420770 (+ 677us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.422110 (+ 1340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.422673 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.422743 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.422753 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.422936 (+ 183us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.422991 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:10:32.423041 2629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.419589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:44529 (local address 127.12.251.2:47061)
0808 05:10:32.419645 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.419657 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.419694 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.419837 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.419838 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.419839 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:32.419911 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.419913 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.420807 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.420808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.422035 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.422038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.422771 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.422772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.422864 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.422868 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.422912 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.422954 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":5}
I20260808 05:10:32.423048 2843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.419611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36285 (local address 127.12.251.2:44909)
0808 05:10:32.419786 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.419795 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.419850 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.419971 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:32.419971 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:32.419973 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:32.420036 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.420037 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.420830 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.420830 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.422035 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:32.422038 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.422758 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.422759 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:32.422870 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.422873 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:10:32.422922 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:10:32.422951 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":24,"thread_start_us":108,"threads_started":1}
I20260808 05:10:32.423408 2756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec50d0918d141cdbee517b23b544636" candidate_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95aa46670b7842b98db3ae3999e76a97" is_pre_election: true
I20260808 05:10:32.423578 2756 raft_consensus.cc:2454] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c2eb2e9d614abe9a5ac9975ecaf4ac in term 0.
I20260808 05:10:32.423760 2361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec50d0918d141cdbee517b23b544636" candidate_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" is_pre_election: true
I20260808 05:10:32.423806 2462 leader_election.cc:302] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c2eb2e9d614abe9a5ac9975ecaf4ac, 95aa46670b7842b98db3ae3999e76a97; no voters:
I20260808 05:10:32.423918 2361 raft_consensus.cc:2454] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47c2eb2e9d614abe9a5ac9975ecaf4ac in term 0.
I20260808 05:10:32.423921 2840 raft_consensus.cc:2781] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:10:32.423972 2840 raft_consensus.cc:482] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:10:32.424012 2840 raft_consensus.cc:3037] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:32.424696 2840 raft_consensus.cc:504] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.424814 2840 leader_election.cc:288] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [CANDIDATE]: Term 1 election: Requested vote from peers 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529), af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285)
I20260808 05:10:32.424978 2756 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec50d0918d141cdbee517b23b544636" candidate_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95aa46670b7842b98db3ae3999e76a97"
I20260808 05:10:32.425052 2756 raft_consensus.cc:3037] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:32.425722 2756 raft_consensus.cc:2454] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c2eb2e9d614abe9a5ac9975ecaf4ac in term 1.
I20260808 05:10:32.425824 2361 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4ec50d0918d141cdbee517b23b544636" candidate_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8bbc03c7304e1f8963bd5b39c54d68"
I20260808 05:10:32.425871 2462 leader_election.cc:302] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47c2eb2e9d614abe9a5ac9975ecaf4ac, 95aa46670b7842b98db3ae3999e76a97; no voters:
I20260808 05:10:32.425912 2361 raft_consensus.cc:3037] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:32.425992 2840 raft_consensus.cc:2781] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:32.426144 2840 raft_consensus.cc:686] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 LEADER]: Becoming Leader. State: Replica: 47c2eb2e9d614abe9a5ac9975ecaf4ac, State: Running, Role: LEADER
I20260808 05:10:32.426239 2840 consensus_queue.cc:237] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.426725 2361 raft_consensus.cc:2454] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47c2eb2e9d614abe9a5ac9975ecaf4ac in term 1.
I20260808 05:10:32.427040 2135 catalog_manager.cc:5495] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2). New cstate: current_term: 1 leader_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } health_report { overall_health: UNKNOWN } } }
I20260808 05:10:32.436144 2832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.434274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38236 (local address 127.12.251.2:46061)
0808 05:10:32.434319 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:32.434320 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:32.434330 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:10:32.434392 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:32.434393 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:32.434408 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:32.434463 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:10:32.434544 (+ 81us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.434971 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.435612 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:32.435786 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:32.435827 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:32.435918 (+ 91us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:10:32.436007 (+ 89us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:10:32.436058 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:32.436070 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 05:10:32.436085 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:10:32.437752 2361 raft_consensus.cc:1261] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Refusing update from remote peer 47c2eb2e9d614abe9a5ac9975ecaf4ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:32.437752 2756 raft_consensus.cc:1261] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 1 FOLLOWER]: Refusing update from remote peer 47c2eb2e9d614abe9a5ac9975ecaf4ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:32.438064 2840 consensus_queue.cc:1035] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:32.438197 2845 consensus_queue.cc:1035] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:32.442196 2135 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:43644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:32.442284 2135 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:43644:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:32.442946 2135 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Sending DeleteTablet for 3 replicas of tablet 4ec50d0918d141cdbee517b23b544636
I20260808 05:10:32.443212 2319 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ec50d0918d141cdbee517b23b544636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:32 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:37298
I20260808 05:10:32.443244 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 2189
I20260808 05:10:32.443233 2530 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ec50d0918d141cdbee517b23b544636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:32 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:38226
I20260808 05:10:32.443305 2436 tablet_replica.cc:330] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: stopping tablet replica
I20260808 05:10:32.443356 2436 raft_consensus.cc:2229] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:10:32.443403 2436 raft_consensus.cc:2258] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:32.460054 2730 tablet_service.cc:1514] Processing DeleteTablet for tablet 4ec50d0918d141cdbee517b23b544636 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:32 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:54474
I20260808 05:10:32.460343 2862 tablet_replica.cc:330] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: stopping tablet replica
I20260808 05:10:32.460340 2864 tablet_replica.cc:330] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: stopping tablet replica
I20260808 05:10:32.460466 2862 raft_consensus.cc:2229] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:10:32.460565 2864 raft_consensus.cc:2229] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:10:32.460585 2862 raft_consensus.cc:2258] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:32.460733 2864 raft_consensus.cc:2258] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:32.461102 2862 ts_tablet_manager.cc:1905] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:32.461313 2864 ts_tablet_manager.cc:1905] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:32.462919 2862 ts_tablet_manager.cc:1918] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:32.463013 2862 log.cc:1196] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/4ec50d0918d141cdbee517b23b544636
I20260808 05:10:32.462936 2864 ts_tablet_manager.cc:1918] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:32.463181 2864 log.cc:1196] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/4ec50d0918d141cdbee517b23b544636
I20260808 05:10:32.463311 2862 ts_tablet_manager.cc:1939] T 4ec50d0918d141cdbee517b23b544636 P 47c2eb2e9d614abe9a5ac9975ecaf4ac: Deleting consensus metadata
I20260808 05:10:32.463524 2864 ts_tablet_manager.cc:1939] T 4ec50d0918d141cdbee517b23b544636 P 95aa46670b7842b98db3ae3999e76a97: Deleting consensus metadata
I20260808 05:10:32.463790 2109 catalog_manager.cc:4841] TS 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061): tablet 4ec50d0918d141cdbee517b23b544636 (table test-table [id=418a946c6a1b4abb9822910961d6b0b6]) successfully deleted
I20260808 05:10:32.463896 2109 catalog_manager.cc:4841] TS 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529): tablet 4ec50d0918d141cdbee517b23b544636 (table test-table [id=418a946c6a1b4abb9822910961d6b0b6]) successfully deleted
W20260808 05:10:32.465065 2108 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:36285 (error 108)
I20260808 05:10:32.465502 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 2429
I20260808 05:10:32.465586 2433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.465446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:36285 (local address 127.0.0.1:37310)
0808 05:10:32.465502 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.465548 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36285: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 05:10:32.472074 2108 catalog_manager.cc:4584] TS af8bbc03c7304e1f8963bd5b39c54d68 (127.12.251.1:36285): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4ec50d0918d141cdbee517b23b544636: Network error: Client connection negotiation failed: client connection to 127.12.251.1:36285: connect: Connection refused (error 111)
I20260808 05:10:32.477958 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 2630
I20260808 05:10:32.490763 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 2085
I20260808 05:10:32.500773 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39893
--webserver_interface=127.12.251.62
--webserver_port=45865
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:39893
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:32.581530 2872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:32.581727 2872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:32.581746 2872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:32.582850 2872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:32.582890 2872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:32.582903 2872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:32.582926 2872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:32.582957 2872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:32.584409 2872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:39893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=45865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:32.584633 2872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:32.584841 2872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:32.589375 2884 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.589370 2881 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.589447 2882 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.589701 2872 server_base.cc:1034] running on GCE node
I20260808 05:10:32.589933 2872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:32.590209 2872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:32.591347 2872 hybrid_clock.cc:648] HybridClock initialized: now 1786165832591333 us; error 24 us; skew 500 ppm
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:32.593708 2872 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:32.594102 2872 webserver.cc:460] Webserver started at http://127.12.251.62:45865/ using document root <none> and password file <none>
I20260808 05:10:32.594295 2872 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:32.594342 2872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:32.595633 2872 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:32.596217 2894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.596365 2872 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.596448 2872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "a0da6326dfc84272a39099f55fd7cef5"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "203a43205b8534cf587cb201eae6ccef"
server_key_iv: "21e2399e949870dadda0971c34043c97"
server_key_version: "encryptionkey@0"
I20260808 05:10:32.596779 2872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:32.605297 2872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:32.607290 2872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:32.607422 2872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:32.611195 2872 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:39893
I20260808 05:10:32.611232 2963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:39893 every 8 connection(s)
I20260808 05:10:32.611588 2872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:32.613060 2964 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:10:32.613714 2964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Bootstrap starting.
I20260808 05:10:32.615660 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 2872
I20260808 05:10:32.615981 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:36285
--local_ip_for_outbound_sockets=127.12.251.1
--tserver_master_addrs=127.12.251.62:39893
--webserver_port=41711
--webserver_interface=127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:32.622627 2964 log.cc:824] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:32.624703 2964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:10:32.624970 2964 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5: Bootstrap complete.
I20260808 05:10:32.627108 2964 raft_consensus.cc:348] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:32.627328 2964 raft_consensus.cc:729] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a0da6326dfc84272a39099f55fd7cef5, State: Initialized, Role: FOLLOWER
I20260808 05:10:32.627477 2964 consensus_queue.cc:260] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:32.627542 2964 raft_consensus.cc:388] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:10:32.627571 2964 raft_consensus.cc:482] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:10:32.627615 2964 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:10:32.628567 2964 raft_consensus.cc:504] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:32.628674 2964 leader_election.cc:302] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a0da6326dfc84272a39099f55fd7cef5; no voters:
I20260808 05:10:32.628842 2964 leader_election.cc:288] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 05:10:32.628952 2973 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 05:10:32.629099 2973 raft_consensus.cc:686] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [term 3 LEADER]: Becoming Leader. State: Replica: a0da6326dfc84272a39099f55fd7cef5, State: Running, Role: LEADER
I20260808 05:10:32.629295 2973 consensus_queue.cc:237] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } }
I20260808 05:10:32.629106 2964 sys_catalog.cc:564] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:32.630072 2976 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "a0da6326dfc84272a39099f55fd7cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } } }
I20260808 05:10:32.630167 2976 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:32.630086 2975 sys_catalog.cc:455] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a0da6326dfc84272a39099f55fd7cef5. Latest consensus state: current_term: 3 leader_uuid: "a0da6326dfc84272a39099f55fd7cef5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a0da6326dfc84272a39099f55fd7cef5" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39893 } } }
I20260808 05:10:32.630359 2975 sys_catalog.cc:458] T 00000000000000000000000000000000 P a0da6326dfc84272a39099f55fd7cef5 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:32.630410 2986 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:32.631338 2986 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:10:32.631454 2986 catalog_manager.cc:1259] Loaded cluster ID: 24c2894de6894ad9bf6cced604c6d144
I20260808 05:10:32.631502 2986 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260808 05:10:32.631995 2986 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7f089ddbd9ad google::LogMessage::Fail() at ??:0
@ 0x7f089ddc088a google::LogMessage::SendToLog() at ??:0
@ 0x7f089ddbd4de google::LogMessage::Flush() at ??:0
@ 0x7f089ddbea19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f08a5cde0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f08a5ce78b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f089fc8b0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f089fc80954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f08a0ae46db start_thread at ??:0
@ 0x7f089c8bb61f clone at ??:0
W20260808 05:10:32.731101 2971 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:32.731453 2971 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:32.731494 2971 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:32.733296 2971 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:32.733359 2971 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:32.733402 2971 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:10:32.735589 2971 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:36285
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=41711
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2971
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:32.735886 2971 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:32.736173 2971 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:32.741429 3027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.741410 3023 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.741410 3024 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.742556 2971 server_base.cc:1034] running on GCE node
I20260808 05:10:32.742739 2971 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:32.742962 2971 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:32.744132 2971 hybrid_clock.cc:648] HybridClock initialized: now 1786165832744114 us; error 36 us; skew 500 ppm
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:32.746603 2971 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:10:32.747085 2971 webserver.cc:460] Webserver started at http://127.12.251.1:41711/ using document root <none> and password file <none>
I20260808 05:10:32.747298 2971 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:32.747341 2971 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:32.748739 2971 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:32.749411 3040 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.749603 2971 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:32.749701 2971 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "af8bbc03c7304e1f8963bd5b39c54d68"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "953908be1dc223de59184548bfe8fd38"
server_key_iv: "13c199e843a3ae9206ea377ad3c29ab1"
server_key_version: "encryptionkey@0"
I20260808 05:10:32.750054 2971 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:32.765295 2971 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:32.767372 2971 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:32.767524 2971 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:32.767737 2971 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:32.768157 3052 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:10:32.770066 2971 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:10:32.770116 2971 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:10:32.770151 2971 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:10:32.770795 2971 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:10:32.770828 2971 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 05:10:32.770922 3052 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap starting.
I20260808 05:10:32.777493 2971 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:36285
I20260808 05:10:32.777619 3203 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:36285 every 8 connection(s)
I20260808 05:10:32.777906 2971 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:10:32.781848 3052 log.cc:824] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:32.782357 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 2971
I20260808 05:10:32.782665 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:46061
--local_ip_for_outbound_sockets=127.12.251.2
--tserver_master_addrs=127.12.251.62:39893
--webserver_port=38491
--webserver_interface=127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:10:32.784060 3052 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:10:32.784307 3052 tablet_bootstrap.cc:492] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Bootstrap complete.
I20260808 05:10:32.785086 3052 ts_tablet_manager.cc:1397] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20260808 05:10:32.786536 3052 raft_consensus.cc:348] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.786870 3052 raft_consensus.cc:729] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8bbc03c7304e1f8963bd5b39c54d68, State: Initialized, Role: FOLLOWER
I20260808 05:10:32.787019 3052 consensus_queue.cc:260] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:32.787297 3052 ts_tablet_manager.cc:1428] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260808 05:10:32.846719 3208 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:10:32.778524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:47749)
0808 05:10:32.778689 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.778733 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:32.779188 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:32.846537 (+ 67349us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":75,"threads_started":1}
W20260808 05:10:32.847008 3205 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:39893 (0 consecutive failures): Network error: Failed to ping master at 127.12.251.62:39893: Client connection negotiation failed: client connection to 127.12.251.62:39893: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:10:32.847364 3208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.847255 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:39769)
0808 05:10:32.847301 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.847342 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 05:10:32.847734 3208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.847639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:37347)
0808 05:10:32.847686 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.847714 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260808 05:10:32.847834 3205 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:10:32.868574 3210 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:32.868779 3210 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:32.868803 3210 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:32.869959 3210 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:32.869998 3210 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:32.870023 3210 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:10:32.871428 3210 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:46061
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=38491
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3210
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:32.871624 3210 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:32.871802 3210 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:32.876487 3218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.876655 3210 server_base.cc:1034] running on GCE node
W20260808 05:10:32.876479 3222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:32.876479 3219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:32.876919 3210 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:32.877161 3210 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:32.878329 3210 hybrid_clock.cc:648] HybridClock initialized: now 1786165832878327 us; error 39 us; skew 500 ppm
Aug 08 05:10:32 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:32.880710 3210 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:10:32.881100 3210 webserver.cc:460] Webserver started at http://127.12.251.2:38491/ using document root <none> and password file <none>
I20260808 05:10:32.881320 3210 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:32.881366 3210 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:32.882601 3210 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:10:32.883127 3236 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.883296 3210 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.883387 3210 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "044db0bb03a2e83a21fadaf843e538cc"
server_key_iv: "eae5c652256acb39d9be119072bf379b"
server_key_version: "encryptionkey@0"
I20260808 05:10:32.883739 3210 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:32.906188 3210 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:32.908113 3210 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:32.908243 3210 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:32.908483 3210 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:32.908803 3210 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:32.908836 3210 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.908857 3210 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:32.908871 3210 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:32.914556 3210 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:46061
I20260808 05:10:32.914644 3404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:46061 every 8 connection(s)
I20260808 05:10:32.914964 3210 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:10:32.916020 3411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.915646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:46613)
0808 05:10:32.915800 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.915877 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
W20260808 05:10:32.916388 3408 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:39893 (0 consecutive failures): Network error: Failed to ping master at 127.12.251.62:39893: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
I20260808 05:10:32.916623 3411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.916542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:58977)
0808 05:10:32.916581 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.916606 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 05:10:32.916821 3411 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:32.916772 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:44971)
0808 05:10:32.916791 (+ 19us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:32.916809 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260808 05:10:32.916900 3408 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:10:32.918566 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 3210
I20260808 05:10:32.918774 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:44529
--local_ip_for_outbound_sockets=127.12.251.3
--tserver_master_addrs=127.12.251.62:39893
--webserver_port=45025
--webserver_interface=127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:46727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:33.001502 3412 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:33.001703 3412 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:33.001726 3412 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:33.003069 3412 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:33.003131 3412 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:33.003159 3412 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:10:33.004688 3412 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:46727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:44529
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=45025
--tserver_master_addrs=127.12.251.62:39893
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3412
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:33.004884 3412 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:33.005090 3412 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:33.009893 3424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:33.009902 3419 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:33.010070 3412 server_base.cc:1034] running on GCE node
W20260808 05:10:33.009905 3421 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:33.010314 3412 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:33.010529 3412 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:33.011658 3412 hybrid_clock.cc:648] HybridClock initialized: now 1786165833011650 us; error 26 us; skew 500 ppm
Aug 08 05:10:33 dist-test-slave-bndk krb5kdc[1238](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165833, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:33.013964 3412 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:10:33.014348 3412 webserver.cc:460] Webserver started at http://127.12.251.3:45025/ using document root <none> and password file <none>
I20260808 05:10:33.014566 3412 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:33.014621 3412 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:33.015861 3412 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:10:33.016376 3431 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:33.016527 3412 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:10:33.016607 3412 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "95aa46670b7842b98db3ae3999e76a97"
format_stamp: "Formatted at 2026-08-08 05:10:31 on dist-test-slave-bndk"
server_key: "ef46ee9281ddc75e86781d90797564e2"
server_key_iv: "41fc8196bf7155b09f56018467cec3ed"
server_key_version: "encryptionkey@0"
I20260808 05:10:33.016919 3412 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:33.024487 3412 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:33.026131 3412 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:33.026253 3412 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:33.026439 3412 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:33.026711 3412 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:33.026742 3412 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:33.026769 3412 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:33.026793 3412 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:33.032198 3412 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:44529
I20260808 05:10:33.032259 3610 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:44529 every 8 connection(s)
I20260808 05:10:33.032564 3412 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:10:33.033584 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:33.033184 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:51371)
0808 05:10:33.033367 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:33.033437 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":122,"threads_started":1}
W20260808 05:10:33.033911 3613 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:39893 (0 consecutive failures): Network error: Failed to ping master at 127.12.251.62:39893: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
I20260808 05:10:33.034154 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:33.034076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:54269)
0808 05:10:33.034115 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:33.034138 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:10:33.034346 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:33.034302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:53919)
0808 05:10:33.034320 (+ 18us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:33.034335 (+ 15us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":11}
W20260808 05:10:33.034420 3613 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:10:33.035106 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 3412
I20260808 05:10:33.848404 3619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:33.848159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:51779)
0808 05:10:33.848294 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:33.848329 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":70,"threads_started":1}
I20260808 05:10:33.917526 3620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:33.917310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:56753)
0808 05:10:33.917436 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:33.917469 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":69,"threads_started":1}
I20260808 05:10:34.034992 3621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:34.034775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:44467)
0808 05:10:34.034898 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:34.034932 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260808 05:10:34.509975 3622 raft_consensus.cc:482] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:34.510133 3622 raft_consensus.cc:504] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:34.510465 3622 leader_election.cc:288] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529), 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061)
Aug 08 05:10:34 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.2@KRBTEST.COM
Aug 08 05:10:34 dist-test-slave-bndk krb5kdc[1238](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165832, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.3@KRBTEST.COM
I20260808 05:10:34.520550 3627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:34.510754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:58491 (local address 127.12.251.3:44529)
0808 05:10:34.510930 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:34.510944 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:34.510986 (+ 42us) server_negotiation.cc:407] Connection header received
0808 05:10:34.511505 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:34.511508 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:34.511553 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:34.511672 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:34.512579 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.513470 (+ 891us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.514458 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.514866 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.514962 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:34.517482 (+ 2520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:34.517485 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:34.517485 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:34.517495 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:34.518938 (+ 1443us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:34.519395 (+ 457us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:34.519397 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:34.519398 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:34.519507 (+ 109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:34.519696 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:34.519697 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:34.519697 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:34.519923 (+ 226us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:34.520016 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:34.520325 (+ 309us) server_negotiation.cc:299] Negotiation successful
0808 05:10:34.520444 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":46,"threads_started":1}
I20260808 05:10:34.520550 3630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:34.510850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46061 (local address 127.12.251.1:51093)
0808 05:10:34.510948 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:34.510957 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:34.511000 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:34.511839 (+ 839us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:34.511840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:34.512195 (+ 355us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:34.512462 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:34.512469 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.513575 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.513576 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:34.514393 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:34.514396 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.514942 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.514943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:34.515050 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:34.515600 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:34.515605 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:34.516976 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:34.518892 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:34.518922 (+ 30us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:34.518924 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:34.519214 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:34.519496 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:34.519496 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:34.519497 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:34.519627 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:34.520002 (+ 375us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:34.520009 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:34.520136 (+ 127us) client_negotiation.cc:769] Sending connection context
0808 05:10:34.520225 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:10:34.520414 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"mutex_wait_us":67,"thread_start_us":51,"threads_started":1}
I20260808 05:10:34.520569 3633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:34.511018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:51093 (local address 127.12.251.2:46061)
0808 05:10:34.511160 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:34.511169 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:34.511186 (+ 17us) server_negotiation.cc:407] Connection header received
0808 05:10:34.511655 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:34.511658 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:34.511710 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:34.511850 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:34.512571 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.513474 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.514476 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.514861 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.514957 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:34.517079 (+ 2122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:34.517083 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:34.517083 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:34.517096 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:34.518787 (+ 1691us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:34.519291 (+ 504us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:34.519295 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:34.519295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:34.519408 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:34.519693 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:34.519694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:34.519694 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:34.519934 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:34.520008 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:34.520335 (+ 327us) server_negotiation.cc:299] Negotiation successful
0808 05:10:34.520460 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260808 05:10:34.520763 3624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:34.510655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:44529 (local address 127.12.251.1:58491)
0808 05:10:34.510786 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:34.510798 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:34.510879 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:34.511744 (+ 865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:34.511747 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:34.512211 (+ 464us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:34.512462 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:34.512469 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.513561 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.513562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:34.514376 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:34.514378 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:34.514950 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:34.514951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:34.515051 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:34.515548 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:34.515566 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:34.517376 (+ 1810us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:34.519014 (+ 1638us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:34.519016 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:34.519016 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:34.519295 (+ 279us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:34.519586 (+ 291us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:34.519587 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:34.519587 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:34.519642 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:34.520055 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:34.520056 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:34.520137 (+ 81us) client_negotiation.cc:769] Sending connection context
0808 05:10:34.520225 (+ 88us) client_negotiation.cc:240] Negotiation successful
0808 05:10:34.520484 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":162,"thread_start_us":79,"threads_started":1}
W20260808 05:10:34.521341 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
W20260808 05:10:34.521435 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
I20260808 05:10:34.521487 3044 leader_election.cc:302] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af8bbc03c7304e1f8963bd5b39c54d68; no voters: 47c2eb2e9d614abe9a5ac9975ecaf4ac, 95aa46670b7842b98db3ae3999e76a97
I20260808 05:10:34.521589 3622 raft_consensus.cc:2726] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:10:34.849000 3624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:34.848862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:54199)
0808 05:10:34.848921 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:34.848958 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:10:34.918099 3635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:34.917890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:58015)
0808 05:10:34.918010 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:34.918053 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":70,"threads_started":1}
I20260808 05:10:35.035629 3636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:35.035434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:58537)
0808 05:10:35.035554 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:35.035590 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":71,"threads_started":1}
I20260808 05:10:35.849687 3638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:35.849478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:48919)
0808 05:10:35.849595 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:35.849638 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":66,"threads_started":1}
I20260808 05:10:35.918686 3639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:35.918489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:36185)
0808 05:10:35.918605 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:35.918640 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":62,"threads_started":1}
I20260808 05:10:36.036260 3640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:36.036059 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:46927)
0808 05:10:36.036181 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:36.036218 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":60,"threads_started":1}
I20260808 05:10:36.426930 3643 raft_consensus.cc:482] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:36.427033 3643 raft_consensus.cc:504] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:36.427191 3643 leader_election.cc:288] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529), 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061)
W20260808 05:10:36.427603 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
W20260808 05:10:36.427683 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
I20260808 05:10:36.427713 3044 leader_election.cc:302] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af8bbc03c7304e1f8963bd5b39c54d68; no voters: 47c2eb2e9d614abe9a5ac9975ecaf4ac, 95aa46670b7842b98db3ae3999e76a97
I20260808 05:10:36.427801 3643 raft_consensus.cc:2726] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:10:36.850355 3644 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:36.850109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:43417)
0808 05:10:36.850253 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:36.850301 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
I20260808 05:10:36.919416 3645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:36.919064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:46345)
0808 05:10:36.919257 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:36.919354 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":176,"thread_start_us":97,"threads_started":1}
I20260808 05:10:37.036882 3646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:37.036694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:56579)
0808 05:10:37.036803 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:37.036841 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":60,"threads_started":1}
I20260808 05:10:37.851075 3648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:37.850812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:39309)
0808 05:10:37.850976 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:37.851017 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":82,"threads_started":1}
I20260808 05:10:37.920018 3649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:37.919804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:45741)
0808 05:10:37.919942 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:37.919974 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":83,"threads_started":1}
I20260808 05:10:38.037585 3651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:38.037382 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:60427)
0808 05:10:38.037507 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:38.037544 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":71,"threads_started":1}
I20260808 05:10:38.851742 3652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:38.851489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:44435)
0808 05:10:38.851642 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:38.851689 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":63,"threads_started":1}
I20260808 05:10:38.920660 3653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:38.920428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:40807)
0808 05:10:38.920581 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:38.920617 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260808 05:10:39.038193 3654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:39.037973 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:45617)
0808 05:10:39.038103 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:39.038149 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260808 05:10:39.416440 3655 raft_consensus.cc:482] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:39.416538 3655 raft_consensus.cc:504] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:39.416695 3655 leader_election.cc:288] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529), 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061)
W20260808 05:10:39.417140 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
W20260808 05:10:39.417259 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
I20260808 05:10:39.417307 3044 leader_election.cc:302] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af8bbc03c7304e1f8963bd5b39c54d68; no voters: 47c2eb2e9d614abe9a5ac9975ecaf4ac, 95aa46670b7842b98db3ae3999e76a97
I20260808 05:10:39.417408 3655 raft_consensus.cc:2726] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:10:39.852451 3656 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:39.852209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:56363)
0808 05:10:39.852357 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:39.852398 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":62,"threads_started":1}
I20260808 05:10:39.921271 3657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:39.921030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:58229)
0808 05:10:39.921151 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:39.921194 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":54,"threads_started":1}
I20260808 05:10:40.038862 3660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:40.038666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:39415)
0808 05:10:40.038782 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:40.038818 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":62,"threads_started":1}
I20260808 05:10:40.853040 3662 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:40.852835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:46385)
0808 05:10:40.852949 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:40.852992 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":62,"threads_started":1}
I20260808 05:10:40.921907 3663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:40.921681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:37007)
0808 05:10:40.921811 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:40.921865 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
I20260808 05:10:41.039434 3664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:41.039234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:35617)
0808 05:10:41.039358 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:41.039392 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":59,"threads_started":1}
I20260808 05:10:41.853631 3665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:41.853426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:49465)
0808 05:10:41.853549 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:41.853582 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260808 05:10:41.922506 3667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:41.922307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:38657)
0808 05:10:41.922425 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:41.922462 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
I20260808 05:10:42.039976 3670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:42.039797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:52757)
0808 05:10:42.039902 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:42.039931 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":60,"threads_started":1}
I20260808 05:10:42.854339 3671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:42.854116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:39647)
0808 05:10:42.854252 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:42.854290 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":79,"threads_started":1}
I20260808 05:10:42.923202 3672 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:42.922963 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:59783)
0808 05:10:42.923107 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:42.923152 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
I20260808 05:10:43.040614 3674 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:43.040391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:55723)
0808 05:10:43.040527 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:43.040563 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260808 05:10:43.512833 3675 raft_consensus.cc:482] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:43.512930 3675 raft_consensus.cc:504] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95aa46670b7842b98db3ae3999e76a97" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 44529 } } peers { permanent_uuid: "47c2eb2e9d614abe9a5ac9975ecaf4ac" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46061 } } peers { permanent_uuid: "af8bbc03c7304e1f8963bd5b39c54d68" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 36285 } }
I20260808 05:10:43.513108 3675 leader_election.cc:288] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529), 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061)
W20260808 05:10:43.513513 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 47c2eb2e9d614abe9a5ac9975ecaf4ac (127.12.251.2:46061): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
W20260808 05:10:43.513581 3044 leader_election.cc:341] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 95aa46670b7842b98db3ae3999e76a97 (127.12.251.3:44529): Not found: Tablet not found: 4ec50d0918d141cdbee517b23b544636
I20260808 05:10:43.513595 3044 leader_election.cc:302] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af8bbc03c7304e1f8963bd5b39c54d68; no voters: 47c2eb2e9d614abe9a5ac9975ecaf4ac, 95aa46670b7842b98db3ae3999e76a97
I20260808 05:10:43.513659 3675 raft_consensus.cc:2726] T 4ec50d0918d141cdbee517b23b544636 P af8bbc03c7304e1f8963bd5b39c54d68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:10:43.854974 3676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:43.854753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:35039)
0808 05:10:43.854880 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:43.854916 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":61,"threads_started":1}
I20260808 05:10:43.923887 3677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:43.923655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:58219)
0808 05:10:43.923787 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:43.923839 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260808 05:10:44.041285 3678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:44.041051 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:34941)
0808 05:10:44.041177 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:44.041212 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260808 05:10:44.855583 3679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:44.855351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:56651)
0808 05:10:44.855498 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:44.855535 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":63,"threads_started":1}
I20260808 05:10:44.924541 3680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:44.924328 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:39987)
0808 05:10:44.924461 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:44.924496 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260808 05:10:45.041851 3681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:45.041650 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:60869)
0808 05:10:45.041772 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:45.041807 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":58,"threads_started":1}
I20260808 05:10:45.856287 3682 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:45.856065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:41679)
0808 05:10:45.856197 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:45.856237 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":63,"threads_started":1}
I20260808 05:10:45.925169 3683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:45.924956 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:52841)
0808 05:10:45.925087 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:45.925125 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260808 05:10:46.042470 3684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:46.042239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:37615)
0808 05:10:46.042374 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:46.042408 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":75,"threads_started":1}
I20260808 05:10:46.856938 3686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:46.856708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:44169)
0808 05:10:46.856850 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:46.856890 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":65,"threads_started":1}
I20260808 05:10:46.925880 3690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:46.925656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:40881)
0808 05:10:46.925792 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:46.925832 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":81,"threads_started":1}
I20260808 05:10:47.043136 3693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:47.042910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:42031)
0808 05:10:47.043046 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:47.043090 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":63,"threads_started":1}
I20260808 05:10:47.857643 3696 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:47.857431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.1:34927)
0808 05:10:47.857563 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:47.857596 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":78,"threads_started":1}
I20260808 05:10:47.926533 3697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:47.926325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.2:58119)
0808 05:10:47.926445 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:47.926476 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":72,"threads_started":1}
I20260808 05:10:48.043853 3700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:48.043613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39893 (local address 127.12.251.3:55509)
0808 05:10:48.043761 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:48.043798 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:39893: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":73,"threads_started":1}
I20260808 05:10:48.045423 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 2971
I20260808 05:10:48.055295 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 3210
I20260808 05:10:48.067092 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 3412
2026-08-08T05:10:48Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18342 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:10:48 dist-test-slave-bndk krb5kdc[3704](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:10:48 dist-test-slave-bndk krb5kdc[3704](info): set up 2 sockets
Aug 08 05:10:48 dist-test-slave-bndk krb5kdc[3704](info): commencing operation
krb5kdc: starting...
W20260808 05:10:49.200476 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.110s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:10:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:10:49Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:10:49.319427 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33499
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:33499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:49.402506 3729 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:49.402697 3729 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:49.402717 3729 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:49.403828 3729 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:10:49.403868 3729 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:10:49.403879 3729 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:10:49.403889 3729 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:10:49.403914 3729 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:49.403939 3729 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:49.403960 3729 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:10:49.403980 3729 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:10:49.405504 3729 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:33499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3729
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:49.405727 3729 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:49.405938 3729 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:49.410686 3738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.410739 3742 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.410799 3740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:49.410701 3729 server_base.cc:1034] running on GCE node
I20260808 05:10:49.411067 3729 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:49.411342 3729 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:49.412485 3729 hybrid_clock.cc:648] HybridClock initialized: now 1786165849412466 us; error 35 us; skew 500 ppm
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:49.414835 3729 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:10:49.415252 3729 webserver.cc:460] Webserver started at http://127.12.251.62:35451/ using document root <none> and password file <none>
I20260808 05:10:49.415467 3729 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:49.415511 3729 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:49.415630 3729 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:49.416613 3729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "15862a148546475db5f929bfb9a1cab6"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "06b472145a82a538fccfb668e39ee659"
server_key_iv: "8871bd237a43140ba3ba50de5740ecd5"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.416952 3729 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "15862a148546475db5f929bfb9a1cab6"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "06b472145a82a538fccfb668e39ee659"
server_key_iv: "8871bd237a43140ba3ba50de5740ecd5"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.418201 3729 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:10:49.418874 3753 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.419049 3729 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:10:49.419132 3729 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "15862a148546475db5f929bfb9a1cab6"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "06b472145a82a538fccfb668e39ee659"
server_key_iv: "8871bd237a43140ba3ba50de5740ecd5"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.419193 3729 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:49.427057 3729 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:49.428575 3729 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:49.428697 3729 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:49.432544 3729 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:33499
I20260808 05:10:49.432590 3837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:33499 every 8 connection(s)
I20260808 05:10:49.432893 3729 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:10:49.433750 3838 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:49.433991 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 3729
I20260808 05:10:49.434077 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:10:49.434253 13292 external_mini_cluster.cc:1428] Setting key 2c9e583e70a88f12d6e59c42c9b4cc73
I20260808 05:10:49.436529 3838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Bootstrap starting.
I20260808 05:10:49.437206 3838 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:49.437525 3838 log.cc:824] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:49.438211 3838 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: No bootstrap required, opened a new log
I20260808 05:10:49.440114 3838 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:10:49.440244 3838 raft_consensus.cc:374] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:49.440279 3838 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15862a148546475db5f929bfb9a1cab6, State: Initialized, Role: FOLLOWER
I20260808 05:10:49.440402 3838 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:10:49.440474 3838 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:10:49.440505 3838 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:10:49.440552 3838 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 0 FOLLOWER]: Advancing to term 1
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:49.441080 3838 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:10:49.441174 3838 leader_election.cc:302] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15862a148546475db5f929bfb9a1cab6; no voters:
I20260808 05:10:49.441357 3838 leader_election.cc:288] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:10:49.441406 3851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:49.441556 3851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 LEADER]: Becoming Leader. State: Replica: 15862a148546475db5f929bfb9a1cab6, State: Running, Role: LEADER
I20260808 05:10:49.441635 3851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:10:49.441645 3838 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:10:49.442022 3853 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "15862a148546475db5f929bfb9a1cab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } } }
I20260808 05:10:49.442101 3853 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:10:49.443373 3854 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15862a148546475db5f929bfb9a1cab6. Latest consensus state: current_term: 1 leader_uuid: "15862a148546475db5f929bfb9a1cab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } } }
W20260808 05:10:49.443442 3869 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260808 05:10:49.443450 3854 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: This master's current role is: LEADER
W20260808 05:10:49.443543 3869 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:10:49.443630 3857 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:10:49.443804 3857 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:10:49.444482 3844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.434735 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60560 (local address 127.12.251.62:33499)
0808 05:10:49.434931 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.434941 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.434976 (+ 35us) server_negotiation.cc:407] Connection header received
0808 05:10:49.435506 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.435515 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.435576 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.435720 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:49.436292 (+ 572us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.437600 (+ 1308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.438399 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.438800 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.438897 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.441161 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:49.441165 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:49.441165 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:49.441177 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:49.442937 (+ 1760us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.443316 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.443320 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.443320 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.443423 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.443643 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.443644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.443645 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.443929 (+ 284us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:49.444100 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.444181 (+ 81us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.444311 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":88,"threads_started":1}
I20260808 05:10:49.445268 3857 catalog_manager.cc:1347] Generated new cluster ID: 19688b543e8c47d2a5ed2c73ad24ab76
I20260808 05:10:49.445322 3857 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:10:49.460045 3857 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:10:49.460556 3857 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:10:49.464946 3857 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Generated new TSK 0
I20260808 05:10:49.465109 3857 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:10:49.493461 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:33499
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:49.579399 3876 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:49.579607 3876 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:49.579638 3876 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:49.580747 3876 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:49.580788 3876 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:49.580822 3876 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:10:49.582255 3876 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3876
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:49.582484 3876 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:49.582708 3876 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:49.587528 3882 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.587579 3883 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.587540 3887 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:49.587692 3876 server_base.cc:1034] running on GCE node
I20260808 05:10:49.587967 3876 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:49.588196 3876 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:49.589341 3876 hybrid_clock.cc:648] HybridClock initialized: now 1786165849589321 us; error 35 us; skew 500 ppm
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:49.591749 3876 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:10:49.592175 3876 webserver.cc:460] Webserver started at http://127.12.251.1:40705/ using document root <none> and password file <none>
I20260808 05:10:49.592370 3876 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:49.592412 3876 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:49.592545 3876 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:49.593621 3876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "987810244d46499e902e03b7dbe41344"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "e142e143882e1d8f3955f83da7f64257"
server_key_iv: "317556324cb491080612c23a5ab5c13b"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.593942 3876 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "987810244d46499e902e03b7dbe41344"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "e142e143882e1d8f3955f83da7f64257"
server_key_iv: "317556324cb491080612c23a5ab5c13b"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.595160 3876 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:10:49.595804 3896 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.595956 3876 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:10:49.596040 3876 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "987810244d46499e902e03b7dbe41344"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "e142e143882e1d8f3955f83da7f64257"
server_key_iv: "317556324cb491080612c23a5ab5c13b"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.596107 3876 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:49.619732 3876 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:49.621587 3876 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:49.621728 3876 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:49.621946 3876 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:49.622246 3876 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:49.622280 3876 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.622309 3876 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:49.622330 3876 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.627820 3876 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:42201
I20260808 05:10:49.627875 4078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:42201 every 8 connection(s)
I20260808 05:10:49.628168 3876 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:10:49.628878 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 3876
I20260808 05:10:49.628996 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:10:49.629257 13292 external_mini_cluster.cc:1428] Setting key cb68cb69a20437a5137fd2178ddc687d
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:49.637779 3844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.628826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:51449 (local address 127.12.251.62:33499)
0808 05:10:49.628897 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.628899 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.629098 (+ 199us) server_negotiation.cc:407] Connection header received
0808 05:10:49.629717 (+ 619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.629718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.629727 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.629765 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:49.630970 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.631488 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.632541 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.632752 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.632809 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.635160 (+ 2351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:49.635161 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:49.635161 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:49.635169 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:49.636396 (+ 1227us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.636850 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.636851 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.636851 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.636900 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.637136 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.637136 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.637137 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.637263 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:49.637329 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.637599 (+ 270us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.637688 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260808 05:10:49.637938 4081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.628791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:51449)
0808 05:10:49.628950 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:49.629012 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:49.629615 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:49.629831 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:49.629835 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:49.630591 (+ 756us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:49.630865 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.630872 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.631581 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.631583 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.632456 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.632458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.632824 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.632825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.632952 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.633456 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:49.633464 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:49.635066 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:49.636478 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:49.636487 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:49.636489 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:49.636781 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:49.636951 (+ 170us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:49.636952 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:49.636953 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:49.637078 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:49.637331 (+ 253us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:49.637340 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:49.637473 (+ 133us) client_negotiation.cc:769] Sending connection context
0808 05:10:49.637571 (+ 98us) client_negotiation.cc:240] Negotiation successful
0808 05:10:49.637720 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":78,"threads_started":1}
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
I20260808 05:10:49.638399 4079 heartbeater.cc:347] Connected to a master server at 127.12.251.62:33499
I20260808 05:10:49.638509 4079 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:49.638679 4079 heartbeater.cc:511] Master 127.12.251.62:33499 requested a full tablet report, sending...
I20260808 05:10:49.639213 3775 ts_manager.cc:194] Registered new tserver with Master: 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201)
I20260808 05:10:49.639804 3775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:51449
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:10:49.654028 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:33499
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:49.735206 4084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:49.735404 4084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:49.735425 4084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:49.736501 4084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:49.736536 4084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:49.736559 4084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:10:49.737982 4084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:49.738173 4084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:49.738343 4084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:49.743012 4094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.743036 4092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.743012 4098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:49.743204 4084 server_base.cc:1034] running on GCE node
I20260808 05:10:49.743536 4084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:49.743749 4084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:49.744880 4084 hybrid_clock.cc:648] HybridClock initialized: now 1786165849744867 us; error 28 us; skew 500 ppm
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:49.747318 4084 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:10:49.747754 4084 webserver.cc:460] Webserver started at http://127.12.251.2:43177/ using document root <none> and password file <none>
I20260808 05:10:49.747956 4084 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:49.748003 4084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:49.748124 4084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:49.749094 4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "46cc4c6bec00433abcc0afae09672e62"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "8c6e3856b12dc2bf471e8c11488dcea7"
server_key_iv: "db7f62ec23292fa2f86001f2a92f25b1"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.749470 4084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "46cc4c6bec00433abcc0afae09672e62"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "8c6e3856b12dc2bf471e8c11488dcea7"
server_key_iv: "db7f62ec23292fa2f86001f2a92f25b1"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.750674 4084 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:10:49.751308 4110 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.751468 4084 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:10:49.751550 4084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "46cc4c6bec00433abcc0afae09672e62"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "8c6e3856b12dc2bf471e8c11488dcea7"
server_key_iv: "db7f62ec23292fa2f86001f2a92f25b1"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.751616 4084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:49.769189 4084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:49.771219 4084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:49.771363 4084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:49.771561 4084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:49.771848 4084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:49.771898 4084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.771934 4084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:49.771952 4084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.777297 4084 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:40093
I20260808 05:10:49.777344 4278 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:40093 every 8 connection(s)
I20260808 05:10:49.777630 4084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:10:49.778285 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 4084
I20260808 05:10:49.778396 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:10:49.778616 13292 external_mini_cluster.cc:1428] Setting key a644127c9b07e8956d34a63b62a7e48d
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:49.787032 3844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.778298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:50261 (local address 127.12.251.62:33499)
0808 05:10:49.778360 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.778362 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.778554 (+ 192us) server_negotiation.cc:407] Connection header received
0808 05:10:49.779145 (+ 591us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.779146 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.779157 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.779202 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:49.780376 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.780864 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.781968 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.782252 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.782314 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.784558 (+ 2244us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:49.784560 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:49.784560 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:49.784567 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:49.785821 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.786171 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.786172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.786172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.786232 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.786438 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.786439 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.786439 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.786549 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:49.786605 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.786855 (+ 250us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.786933 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260808 05:10:49.787174 4283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.778248 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:50261)
0808 05:10:49.778408 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:49.778455 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:49.779054 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:49.779288 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:49.779292 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:49.780020 (+ 728us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:49.780286 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.780293 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.780951 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.780952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.781873 (+ 921us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.781875 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.782341 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.782342 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.782475 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.782919 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:49.782929 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:49.784473 (+ 1544us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:49.785894 (+ 1421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:49.785900 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:49.785903 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:49.786106 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:49.786285 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:49.786285 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:49.786286 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:49.786384 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:49.786603 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:49.786609 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:49.786740 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 05:10:49.786824 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:10:49.786972 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
I20260808 05:10:49.787599 4279 heartbeater.cc:347] Connected to a master server at 127.12.251.62:33499
I20260808 05:10:49.787683 4279 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:49.787842 4279 heartbeater.cc:511] Master 127.12.251.62:33499 requested a full tablet report, sending...
I20260808 05:10:49.788187 3775 ts_manager.cc:194] Registered new tserver with Master: 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093)
I20260808 05:10:49.788540 3775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:50261
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:10:49.803114 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:33499
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:10:49.884496 4291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:10:49.884696 4291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:10:49.884728 4291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:10:49.885895 4291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:10:49.885936 4291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:10:49.885970 4291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:10:49.887392 4291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:10:49.887624 4291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:10:49.887837 4291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:10:49.892642 4298 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.892650 4300 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:10:49.892642 4297 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:10:49.892887 4291 server_base.cc:1034] running on GCE node
I20260808 05:10:49.893077 4291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:10:49.893327 4291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:10:49.894469 4291 hybrid_clock.cc:648] HybridClock initialized: now 1786165849894457 us; error 30 us; skew 500 ppm
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:10:49.896879 4291 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:10:49.897368 4291 webserver.cc:460] Webserver started at http://127.12.251.3:40867/ using document root <none> and password file <none>
I20260808 05:10:49.897575 4291 fs_manager.cc:359] Metadata directory not provided
I20260808 05:10:49.897615 4291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:10:49.897707 4291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:10:49.898685 4291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "4c7a1647a70946b9a684db53ad235549"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "7747caa1a7ece62c391f5261e8d4793e"
server_key_iv: "6ca069dbda1cf81e229384c67859e618"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.899019 4291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "4c7a1647a70946b9a684db53ad235549"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "7747caa1a7ece62c391f5261e8d4793e"
server_key_iv: "6ca069dbda1cf81e229384c67859e618"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.900277 4291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:10:49.900933 4310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.901088 4291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.901170 4291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "4c7a1647a70946b9a684db53ad235549"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "7747caa1a7ece62c391f5261e8d4793e"
server_key_iv: "6ca069dbda1cf81e229384c67859e618"
server_key_version: "encryptionkey@0"
I20260808 05:10:49.901266 4291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:10:49.919027 4291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:10:49.921204 4291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:10:49.921391 4291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:10:49.921602 4291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:10:49.921914 4291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:10:49.921949 4291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.921978 4291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:10:49.922001 4291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:10:49.927666 4291 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:42431
I20260808 05:10:49.927707 4490 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:42431 every 8 connection(s)
I20260808 05:10:49.928006 4291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:10:49 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165849, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:10:49.936264 3844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.928684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:56495 (local address 127.12.251.62:33499)
0808 05:10:49.928744 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.928746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.928949 (+ 203us) server_negotiation.cc:407] Connection header received
0808 05:10:49.929458 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.929459 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.929470 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.929558 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:49.930426 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.930929 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.931929 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.932114 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.932160 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.934103 (+ 1943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:49.934105 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:49.934105 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:49.934113 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:49.935223 (+ 1110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.935571 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.935572 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.935572 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.935626 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.935800 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.935801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.935801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.935893 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:49.935938 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.936138 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.936198 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:10:49.936415 4493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.928672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:56495)
0808 05:10:49.928826 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:49.928868 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:49.929372 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:49.929612 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:49.929615 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:49.930152 (+ 537us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:10:49.930355 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.930360 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.931029 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.931030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.931859 (+ 829us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.931861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.932174 (+ 313us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.932174 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.932270 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.932708 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:10:49.932716 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:10:49.934014 (+ 1298us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:10:49.935289 (+ 1275us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:49.935294 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:49.935296 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:49.935513 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:49.935673 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:10:49.935674 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:10:49.935674 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:10:49.935760 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:10:49.935934 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:10:49.935936 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:10:49.936045 (+ 109us) client_negotiation.cc:769] Sending connection context
0808 05:10:49.936121 (+ 76us) client_negotiation.cc:240] Negotiation successful
0808 05:10:49.936233 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
I20260808 05:10:49.936833 4491 heartbeater.cc:347] Connected to a master server at 127.12.251.62:33499
I20260808 05:10:49.936926 4491 heartbeater.cc:464] Registering TS with master...
I20260808 05:10:49.937103 4491 heartbeater.cc:511] Master 127.12.251.62:33499 requested a full tablet report, sending...
I20260808 05:10:49.937486 3775 ts_manager.cc:194] Registered new tserver with Master: 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431)
I20260808 05:10:49.937625 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 4291
I20260808 05:10:49.937886 3775 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:56495
I20260808 05:10:49.938486 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:10:49.938733 13292 external_mini_cluster.cc:1428] Setting key 5d6de08b8dc6cc061335784bc2fe5314
I20260808 05:10:49.939898 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:10:49.949818 3844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.941492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60576 (local address 127.12.251.62:33499)
0808 05:10:49.941537 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.941539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.941644 (+ 105us) server_negotiation.cc:407] Connection header received
0808 05:10:49.941719 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.941720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.941731 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.941791 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:10:49.942568 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.943216 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.944228 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.944459 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.944519 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.947171 (+ 2652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:10:49.947173 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:10:49.947173 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:10:49.947182 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:10:49.948577 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.948935 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.948937 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.948938 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.949009 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:10:49.949210 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:10:49.949211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:10:49.949212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:10:49.949422 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:10:49.949525 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.949676 (+ 151us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.949751 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:10:49.951424 3775 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60576:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:10:49.953294 3775 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:10:49.961529 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.957558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52594 (local address 127.12.251.2:40093)
0808 05:10:49.957727 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.957732 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.957742 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:10:49.957782 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.957784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.957800 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.957872 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:49.958251 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.959308 (+ 1057us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.960406 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.961105 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.961181 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.961268 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.961405 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.961449 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":65,"threads_started":1}
I20260808 05:10:49.961519 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.957452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:40093 (local address 127.0.0.1:52594)
0808 05:10:49.957618 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:49.957628 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:49.957681 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:49.958122 (+ 441us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:49.958123 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:49.958125 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:49.958161 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.958162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.959422 (+ 1260us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.959423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.960321 (+ 898us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.960323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.961191 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.961192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.961294 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.961311 (+ 17us) client_negotiation.cc:769] Sending connection context
0808 05:10:49.961382 (+ 71us) client_negotiation.cc:240] Negotiation successful
0808 05:10:49.961414 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":51,"threads_started":1}
I20260808 05:10:49.961519 4503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.957243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:42431 (local address 127.0.0.1:58554)
0808 05:10:49.957353 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:49.957394 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:49.957458 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:49.957886 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:49.957889 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:49.957891 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:49.957957 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.957959 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.959164 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.959165 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.960391 (+ 1226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.960394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.961204 (+ 810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.961205 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.961300 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.961311 (+ 11us) client_negotiation.cc:769] Sending connection context
0808 05:10:49.961359 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:10:49.961414 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84,"mutex_wait_us":26,"thread_start_us":58,"threads_started":1}
I20260808 05:10:49.961668 4504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.957252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:42201 (local address 127.0.0.1:36902)
0808 05:10:49.957549 (+ 297us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:49.957557 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:49.957594 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:49.957967 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:49.957968 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:49.957971 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:49.958026 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.958028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.959412 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.959413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.960569 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:49.960572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.961465 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.961466 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:49.961528 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.961533 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:10:49.961563 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 05:10:49.961600 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"mutex_wait_us":72,"thread_start_us":55,"threads_started":1}
I20260808 05:10:49.961819 4513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.957579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58554 (local address 127.12.251.3:42431)
0808 05:10:49.957736 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.957741 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.957750 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:10:49.957784 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.957785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.957797 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.957868 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:49.958034 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.959062 (+ 1028us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.960489 (+ 1427us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.961118 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.961553 (+ 435us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.961680 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.961708 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.961748 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":94,"threads_started":1}
I20260808 05:10:49.962224 4510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:49.957437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36902 (local address 127.12.251.1:42201)
0808 05:10:49.957797 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:49.957801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:49.957809 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:10:49.957844 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:49.957846 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:49.957859 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:49.958105 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:49.958187 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.959323 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.960642 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:49.961358 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:49.962027 (+ 669us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:49.962093 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:49.962117 (+ 24us) server_negotiation.cc:299] Negotiation successful
0808 05:10:49.962153 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":91,"threads_started":1}
I20260808 05:10:49.962371 4384 tablet_service.cc:1467] Processing CreateTablet for tablet 89bfd475fda3436c92e3be8ba86b6713 (DEFAULT_TABLE table=test-table [id=f662772e9ba84443a3ded04d35dcbdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:49.962394 4184 tablet_service.cc:1467] Processing CreateTablet for tablet 89bfd475fda3436c92e3be8ba86b6713 (DEFAULT_TABLE table=test-table [id=f662772e9ba84443a3ded04d35dcbdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:49.962667 4384 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89bfd475fda3436c92e3be8ba86b6713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:49.962730 4184 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89bfd475fda3436c92e3be8ba86b6713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:49.962860 3968 tablet_service.cc:1467] Processing CreateTablet for tablet 89bfd475fda3436c92e3be8ba86b6713 (DEFAULT_TABLE table=test-table [id=f662772e9ba84443a3ded04d35dcbdbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:10:49.963141 3968 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 89bfd475fda3436c92e3be8ba86b6713. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:10:49.965099 4514 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Bootstrap starting.
I20260808 05:10:49.965919 4516 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Bootstrap starting.
I20260808 05:10:49.966162 4517 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Bootstrap starting.
I20260808 05:10:49.966243 4514 tablet_bootstrap.cc:654] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:49.966536 4516 tablet_bootstrap.cc:654] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:49.966797 4517 tablet_bootstrap.cc:654] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Neither blocks nor log segments found. Creating new log.
I20260808 05:10:49.966825 4514 log.cc:824] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:49.967058 4516 log.cc:824] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:49.967345 4517 log.cc:824] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Log is configured to *not* fsync() on all Append() calls
I20260808 05:10:49.967722 4514 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: No bootstrap required, opened a new log
I20260808 05:10:49.967834 4514 ts_tablet_manager.cc:1397] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:10:49.967922 4516 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: No bootstrap required, opened a new log
I20260808 05:10:49.967998 4516 ts_tablet_manager.cc:1397] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:10:49.968636 4517 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: No bootstrap required, opened a new log
I20260808 05:10:49.968712 4517 ts_tablet_manager.cc:1397] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260808 05:10:49.969884 4516 raft_consensus.cc:348] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:49.970100 4516 raft_consensus.cc:374] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:49.970147 4516 raft_consensus.cc:729] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46cc4c6bec00433abcc0afae09672e62, State: Initialized, Role: FOLLOWER
I20260808 05:10:49.970294 4516 consensus_queue.cc:260] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:49.970594 4279 heartbeater.cc:503] Master 127.12.251.62:33499 was elected leader, sending a full tablet report...
I20260808 05:10:49.970633 4517 raft_consensus.cc:348] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:49.970800 4517 raft_consensus.cc:374] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:49.970839 4517 raft_consensus.cc:729] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987810244d46499e902e03b7dbe41344, State: Initialized, Role: FOLLOWER
I20260808 05:10:49.970580 4516 ts_tablet_manager.cc:1428] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:10:49.970953 4517 consensus_queue.cc:260] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:49.971211 4517 ts_tablet_manager.cc:1428] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:10:49.971252 4079 heartbeater.cc:503] Master 127.12.251.62:33499 was elected leader, sending a full tablet report...
I20260808 05:10:49.972820 4514 raft_consensus.cc:348] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:49.972981 4514 raft_consensus.cc:374] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:10:49.973059 4514 raft_consensus.cc:729] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7a1647a70946b9a684db53ad235549, State: Initialized, Role: FOLLOWER
I20260808 05:10:49.973167 4514 consensus_queue.cc:260] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:49.973474 4514 ts_tablet_manager.cc:1428] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s
I20260808 05:10:49.973623 4491 heartbeater.cc:503] Master 127.12.251.62:33499 was elected leader, sending a full tablet report...
W20260808 05:10:50.028141 4282 tablet.cc:2369] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:10:50.128911 4080 tablet.cc:2369] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:10:50.157861 4526 raft_consensus.cc:482] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:10:50.157992 4526 raft_consensus.cc:504] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:50.158329 4526 leader_election.cc:288] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093), 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201)
I20260808 05:10:50.161064 4510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:50.158580 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:58231 (local address 127.12.251.1:42201)
0808 05:10:50.158627 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:50.158629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:50.158641 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:10:50.158691 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:50.158693 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:50.158705 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:50.158764 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:50.158929 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.159433 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.160379 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.160738 (+ 359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.160791 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:50.160798 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:50.160961 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 05:10:50.160996 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:10:50.161059 4493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:50.158510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:42201 (local address 127.12.251.3:58231)
0808 05:10:50.158572 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:50.158584 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:50.158629 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:50.158777 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:50.158778 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:50.158780 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:50.158861 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:50.158863 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.159517 (+ 654us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.159519 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:50.160287 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:50.160289 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.160814 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.160815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:50.160892 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:50.160896 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:10:50.160946 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:10:50.160976 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 05:10:50.161123 4511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:50.158607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:60071 (local address 127.12.251.2:40093)
0808 05:10:50.158680 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:50.158682 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:50.158785 (+ 103us) server_negotiation.cc:407] Connection header received
0808 05:10:50.158838 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:50.158839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:50.158852 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:50.158913 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:10:50.159072 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.159543 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.160431 (+ 888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.160809 (+ 378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.160879 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:50.160888 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:50.161028 (+ 140us) server_negotiation.cc:299] Negotiation successful
0808 05:10:50.161065 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260808 05:10:50.161176 4527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:50.158531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:40093 (local address 127.12.251.3:60071)
0808 05:10:50.158717 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:50.158726 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:10:50.158779 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:10:50.158922 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:10:50.158923 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:10:50.158924 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:10:50.159008 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:50.159010 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.159619 (+ 609us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.159620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:50.160342 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:10:50.160345 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.160883 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.160884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:10:50.160951 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:50.160956 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:10:50.161008 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:10:50.161045 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":102,"threads_started":1}
I20260808 05:10:50.161459 4000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bfd475fda3436c92e3be8ba86b6713" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "987810244d46499e902e03b7dbe41344" is_pre_election: true
I20260808 05:10:50.161609 4000 raft_consensus.cc:2454] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 0.
I20260808 05:10:50.161664 4215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bfd475fda3436c92e3be8ba86b6713" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46cc4c6bec00433abcc0afae09672e62" is_pre_election: true
I20260808 05:10:50.161829 4215 raft_consensus.cc:2454] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 0.
I20260808 05:10:50.161850 4315 leader_election.cc:302] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7a1647a70946b9a684db53ad235549, 987810244d46499e902e03b7dbe41344; no voters:
I20260808 05:10:50.161979 4526 raft_consensus.cc:2781] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:10:50.162024 4526 raft_consensus.cc:482] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:10:50.162038 4526 raft_consensus.cc:3037] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:50.162791 4526 raft_consensus.cc:504] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:50.162907 4526 leader_election.cc:288] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 election: Requested vote from peers 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093), 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201)
I20260808 05:10:50.163065 4000 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bfd475fda3436c92e3be8ba86b6713" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "987810244d46499e902e03b7dbe41344"
I20260808 05:10:50.163110 4215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "89bfd475fda3436c92e3be8ba86b6713" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46cc4c6bec00433abcc0afae09672e62"
I20260808 05:10:50.163148 4000 raft_consensus.cc:3037] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:50.163177 4215 raft_consensus.cc:3037] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:10:50.163843 4215 raft_consensus.cc:2454] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 1.
I20260808 05:10:50.163866 4000 raft_consensus.cc:2454] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 1.
I20260808 05:10:50.164003 4315 leader_election.cc:302] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7a1647a70946b9a684db53ad235549, 987810244d46499e902e03b7dbe41344; no voters:
I20260808 05:10:50.164121 4526 raft_consensus.cc:2781] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:10:50.164280 4526 raft_consensus.cc:686] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 1 LEADER]: Becoming Leader. State: Replica: 4c7a1647a70946b9a684db53ad235549, State: Running, Role: LEADER
I20260808 05:10:50.164469 4526 consensus_queue.cc:237] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:10:50.165241 3775 catalog_manager.cc:5495] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c7a1647a70946b9a684db53ad235549 (127.12.251.3). New cstate: current_term: 1 leader_uuid: "4c7a1647a70946b9a684db53ad235549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } health_report { overall_health: UNKNOWN } } }
W20260808 05:10:50.178531 4492 tablet.cc:2369] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:10:50.186650 4513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:50.184379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58562 (local address 127.12.251.3:42431)
0808 05:10:50.184432 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:10:50.184434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:10:50.184441 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:10:50.184477 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:10:50.184478 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:10:50.184500 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:10:50.184568 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:10:50.184683 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.185155 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.185905 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:10:50.186116 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:10:50.186174 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:10:50.186313 (+ 139us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:10:50.186420 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:10:50.186493 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:10:50.186535 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 05:10:50.186557 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:10:50.188320 4000 raft_consensus.cc:1261] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Refusing update from remote peer 4c7a1647a70946b9a684db53ad235549: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:50.188320 4215 raft_consensus.cc:1261] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Refusing update from remote peer 4c7a1647a70946b9a684db53ad235549: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:10:50.188663 4529 consensus_queue.cc:1035] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:50.188788 4526 consensus_queue.cc:1035] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:10:50.193339 3774 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60576:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:50.193439 3774 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60576:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:10:50.194195 3774 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Sending DeleteTablet for 3 replicas of tablet 89bfd475fda3436c92e3be8ba86b6713
I20260808 05:10:50.194494 4384 tablet_service.cc:1514] Processing DeleteTablet for tablet 89bfd475fda3436c92e3be8ba86b6713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:50 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:58554
I20260808 05:10:50.194561 4184 tablet_service.cc:1514] Processing DeleteTablet for tablet 89bfd475fda3436c92e3be8ba86b6713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:50 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:52594
I20260808 05:10:50.194667 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 3876
I20260808 05:10:50.194746 3968 tablet_service.cc:1514] Processing DeleteTablet for tablet 89bfd475fda3436c92e3be8ba86b6713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:50 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36902
I20260808 05:10:50.198596 4553 tablet_replica.cc:330] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: stopping tablet replica
I20260808 05:10:50.198706 4553 raft_consensus.cc:2229] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:10:50.198807 4553 raft_consensus.cc:2258] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:50.204308 4552 tablet_replica.cc:330] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: stopping tablet replica
I20260808 05:10:50.204479 4552 raft_consensus.cc:2229] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:10:50.204638 4552 raft_consensus.cc:2258] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:10:50.205169 4553 ts_tablet_manager.cc:1905] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:50.206869 4553 ts_tablet_manager.cc:1918] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:50.206947 4553 log.cc:1196] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/89bfd475fda3436c92e3be8ba86b6713
I20260808 05:10:50.207295 4553 ts_tablet_manager.cc:1939] T 89bfd475fda3436c92e3be8ba86b6713 P 46cc4c6bec00433abcc0afae09672e62: Deleting consensus metadata
I20260808 05:10:50.207772 3756 catalog_manager.cc:4841] TS 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093): tablet 89bfd475fda3436c92e3be8ba86b6713 (table test-table [id=f662772e9ba84443a3ded04d35dcbdbe]) successfully deleted
W20260808 05:10:50.209416 3757 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:42201 (error 108)
I20260808 05:10:50.209893 4509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:10:50.209767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:42201 (local address 127.0.0.1:36912)
0808 05:10:50.209819 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:10:50.209858 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:42201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:10:50.209986 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 4084
I20260808 05:10:50.210273 4552 ts_tablet_manager.cc:1905] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:10:50.212082 4552 ts_tablet_manager.cc:1918] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:10:50.212146 4552 log.cc:1196] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/89bfd475fda3436c92e3be8ba86b6713
I20260808 05:10:50.212381 4552 ts_tablet_manager.cc:1939] T 89bfd475fda3436c92e3be8ba86b6713 P 4c7a1647a70946b9a684db53ad235549: Deleting consensus metadata
I20260808 05:10:50.212826 3756 catalog_manager.cc:4841] TS 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431): tablet 89bfd475fda3436c92e3be8ba86b6713 (table test-table [id=f662772e9ba84443a3ded04d35dcbdbe]) successfully deleted
W20260808 05:10:50.215867 3757 catalog_manager.cc:4584] TS 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 89bfd475fda3436c92e3be8ba86b6713: Network error: Client connection negotiation failed: client connection to 127.12.251.1:42201: connect: Connection refused (error 111)
I20260808 05:10:50.221091 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 4291
I20260808 05:10:50.229393 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 3729
I20260808 05:11:10.243554 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33499
--webserver_interface=127.12.251.62
--webserver_port=35451
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:33499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:10.326191 4557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:10.326393 4557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:10.326414 4557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:10.327530 4557 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:11:10.327569 4557 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:11:10.327579 4557 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:11:10.327589 4557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:10.327600 4557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:10.327612 4557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:10.327625 4557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:10.327647 4557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:10.329103 4557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:33499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=35451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:10.329360 4557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:10.329578 4557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:10.338480 4573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:10.338500 4567 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:10.338552 4557 server_base.cc:1034] running on GCE node
W20260808 05:11:10.338495 4570 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:10.338945 4557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:10.339234 4557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:10.340378 4557 hybrid_clock.cc:648] HybridClock initialized: now 1786165870340357 us; error 35 us; skew 500 ppm
Aug 08 05:11:10 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165870, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:10.342798 4557 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:11:10.343243 4557 webserver.cc:460] Webserver started at http://127.12.251.62:35451/ using document root <none> and password file <none>
I20260808 05:11:10.343451 4557 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:10.343514 4557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:10.344870 4557 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:10.345458 4582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.345605 4557 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:11:10.345690 4557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "15862a148546475db5f929bfb9a1cab6"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "06b472145a82a538fccfb668e39ee659"
server_key_iv: "8871bd237a43140ba3ba50de5740ecd5"
server_key_version: "encryptionkey@0"
I20260808 05:11:10.346078 4557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:10.357344 4557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:10.359081 4557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:10.359206 4557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:10.363054 4557 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:33499
I20260808 05:11:10.363085 4657 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:33499 every 8 connection(s)
I20260808 05:11:10.363440 4557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:10.364868 4658 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:11:10.365583 4658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Bootstrap starting.
I20260808 05:11:10.369506 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 4557
I20260808 05:11:10.369809 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:42201
--local_ip_for_outbound_sockets=127.12.251.1
--tserver_master_addrs=127.12.251.62:33499
--webserver_port=40705
--webserver_interface=127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:11:10.374776 4658 log.cc:824] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:10.376598 4658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:11:10.376868 4658 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Bootstrap complete.
I20260808 05:11:10.379101 4658 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:10.379334 4658 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15862a148546475db5f929bfb9a1cab6, State: Initialized, Role: FOLLOWER
I20260808 05:11:10.379479 4658 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:10.379540 4658 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:10.379586 4658 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:10.379633 4658 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 1 FOLLOWER]: Advancing to term 2
I20260808 05:11:10.380628 4658 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:10.380717 4658 leader_election.cc:302] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15862a148546475db5f929bfb9a1cab6; no voters:
I20260808 05:11:10.380875 4658 leader_election.cc:288] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260808 05:11:10.380924 4662 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 FOLLOWER]: Leader election won for term 2
I20260808 05:11:10.381081 4662 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 LEADER]: Becoming Leader. State: Replica: 15862a148546475db5f929bfb9a1cab6, State: Running, Role: LEADER
I20260808 05:11:10.381145 4658 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:10.381206 4662 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:10.381628 4663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "15862a148546475db5f929bfb9a1cab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } } }
I20260808 05:11:10.381716 4663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:10.381867 4664 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15862a148546475db5f929bfb9a1cab6. Latest consensus state: current_term: 2 leader_uuid: "15862a148546475db5f929bfb9a1cab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } } }
I20260808 05:11:10.381920 4664 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:10.381979 4674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:10.382807 4674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:10.382913 4674 catalog_manager.cc:1259] Loaded cluster ID: 19688b543e8c47d2a5ed2c73ad24ab76
I20260808 05:11:10.382947 4674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:10.384068 4674 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:10.384250 4674 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Loaded TSK: 0
I20260808 05:11:10.394531 4674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Generated new TSK 1
I20260808 05:11:10.394629 4674 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:11:10.453979 4660 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:10.454167 4660 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:10.454195 4660 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:10.455310 4660 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:10.455350 4660 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:10.455384 4660 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:10.456808 4660 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:42201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=40705
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4660
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:10.457041 4660 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:10.457278 4660 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:10.461951 4694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:10.461954 4698 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:10.461959 4695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:10.462265 4660 server_base.cc:1034] running on GCE node
I20260808 05:11:10.462445 4660 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:10.462659 4660 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:10.463802 4660 hybrid_clock.cc:648] HybridClock initialized: now 1786165870463788 us; error 31 us; skew 500 ppm
Aug 08 05:11:10 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165870, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:10.466526 4660 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:11:10.467073 4660 webserver.cc:460] Webserver started at http://127.12.251.1:40705/ using document root <none> and password file <none>
I20260808 05:11:10.467345 4660 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:10.467442 4660 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:10.469237 4660 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:11:10.470060 4708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.470240 4660 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:10.470338 4660 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "987810244d46499e902e03b7dbe41344"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "e142e143882e1d8f3955f83da7f64257"
server_key_iv: "317556324cb491080612c23a5ab5c13b"
server_key_version: "encryptionkey@0"
I20260808 05:11:10.470767 4660 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:10.492631 4660 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:10.495059 4660 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:10.495219 4660 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:10.495486 4660 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:10.495981 4719 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:11:10.497450 4660 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:11:10.497511 4660 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:11:10.497547 4660 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:11:10.498420 4660 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:11:10.498466 4660 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 05:11:10.498522 4719 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Bootstrap starting.
I20260808 05:11:10.505172 4660 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:42201
I20260808 05:11:10.505368 4874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:42201 every 8 connection(s)
I20260808 05:11:10.505686 4660 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:11:10.505895 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 4660
I20260808 05:11:10.506232 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:40093
--local_ip_for_outbound_sockets=127.12.251.2
--tserver_master_addrs=127.12.251.62:33499
--webserver_port=43177
--webserver_interface=127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:11:10.508774 4719 log.cc:824] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:10.511209 4719 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:11:10.511584 4719 tablet_bootstrap.cc:492] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Bootstrap complete.
I20260808 05:11:10.512691 4719 ts_tablet_manager.cc:1397] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.010s
I20260808 05:11:10.514075 4719 raft_consensus.cc:348] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.514474 4719 raft_consensus.cc:729] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987810244d46499e902e03b7dbe41344, State: Initialized, Role: FOLLOWER
I20260808 05:11:10.514678 4719 consensus_queue.cc:260] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.514997 4719 ts_tablet_manager.cc:1428] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
Aug 08 05:11:10 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165870, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:10.520820 4884 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.509825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:54729)
0808 05:11:10.510128 (+ 303us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.510170 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.511212 (+ 1042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.511853 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.511857 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.512186 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:10.512502 (+ 316us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.512510 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.514186 (+ 1676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.514186 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.515291 (+ 1105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.515294 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.515842 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.515843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.515965 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.516424 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:10.516432 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:10.517771 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:10.519365 (+ 1594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:10.519372 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:10.519374 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:10.519584 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:10.519802 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:10.519803 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:10.519803 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:10.519905 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:10.520229 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:10.520235 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:10.520364 (+ 129us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.520460 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.520620 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":260,"thread_start_us":82,"threads_started":1}
I20260808 05:11:10.520820 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.509921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:54729 (local address 127.12.251.62:33499)
0808 05:11:10.510101 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.510110 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.510346 (+ 236us) server_negotiation.cc:407] Connection header received
0808 05:11:10.511517 (+ 1171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.511524 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.511586 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.511716 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:10.512681 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.514065 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.515370 (+ 1305us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.515760 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.515857 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.517865 (+ 2008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:10.517869 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:10.517869 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:10.517880 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:10.519288 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.519657 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.519660 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.519660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.519743 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.519959 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.519960 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.519960 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.520164 (+ 204us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:10.520235 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.520532 (+ 297us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.520651 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":92,"threads_started":1}
I20260808 05:11:10.521478 4876 heartbeater.cc:347] Connected to a master server at 127.12.251.62:33499
I20260808 05:11:10.521574 4876 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:10.521731 4876 heartbeater.cc:511] Master 127.12.251.62:33499 requested a full tablet report, sending...
I20260808 05:11:10.522392 4609 ts_manager.cc:194] Registered new tserver with Master: 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201)
I20260808 05:11:10.523381 4609 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:54729
I20260808 05:11:10.524183 4876 heartbeater.cc:503] Master 127.12.251.62:33499 was elected leader, sending a full tablet report...
I20260808 05:11:10.527123 4891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.522917 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:42201 (local address 127.0.0.1:42174)
0808 05:11:10.523743 (+ 826us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.523776 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.524369 (+ 593us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.524629 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.524632 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.524635 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:10.524690 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.524691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.525504 (+ 813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.525505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.526267 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.526269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.526846 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.526847 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.526926 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.526938 (+ 12us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.527003 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.527056 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"thread_start_us":91,"threads_started":1}
I20260808 05:11:10.527123 4892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.523136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42174 (local address 127.12.251.1:42201)
0808 05:11:10.523677 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.523681 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.524339 (+ 658us) server_negotiation.cc:407] Connection header received
0808 05:11:10.524473 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.524476 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.524491 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.524566 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:10.524752 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.525427 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.526344 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.526774 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.526834 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.526886 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.527029 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.527064 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":508,"thread_start_us":62,"threads_started":1}
I20260808 05:11:10.527458 4764 tablet_service.cc:1514] Processing DeleteTablet for tablet 89bfd475fda3436c92e3be8ba86b6713 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:10:50 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:42174
I20260808 05:11:10.527915 4895 tablet_replica.cc:330] stopping tablet replica
I20260808 05:11:10.528020 4895 raft_consensus.cc:2229] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:10.528085 4895 raft_consensus.cc:2258] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:10.528370 4895 ts_tablet_manager.cc:1905] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:10.530750 4895 ts_tablet_manager.cc:1918] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:10.530824 4895 log.cc:1196] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal/wals/89bfd475fda3436c92e3be8ba86b6713
I20260808 05:11:10.531055 4895 ts_tablet_manager.cc:1939] T 89bfd475fda3436c92e3be8ba86b6713 P 987810244d46499e902e03b7dbe41344: Deleting consensus metadata
I20260808 05:11:10.531555 4587 catalog_manager.cc:4841] TS 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201): tablet 89bfd475fda3436c92e3be8ba86b6713 (table test-table [id=f662772e9ba84443a3ded04d35dcbdbe]) successfully deleted
W20260808 05:11:10.593757 4880 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:10.593955 4880 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:10.593976 4880 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:10.595088 4880 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:10.595127 4880 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:10.595153 4880 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:10.596611 4880 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:40093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=43177
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:10.596828 4880 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:10.597034 4880 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:10.601684 4904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:10.601662 4905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:10.601681 4907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:10.601919 4880 server_base.cc:1034] running on GCE node
I20260808 05:11:10.602149 4880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:10.602368 4880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:10.603541 4880 hybrid_clock.cc:648] HybridClock initialized: now 1786165870603523 us; error 28 us; skew 500 ppm
Aug 08 05:11:10 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165870, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:10.606074 4880 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:11:10.606503 4880 webserver.cc:460] Webserver started at http://127.12.251.2:43177/ using document root <none> and password file <none>
I20260808 05:11:10.606704 4880 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:10.606762 4880 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:10.608072 4880 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:10.608636 4915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.608795 4880 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:10.608886 4880 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "46cc4c6bec00433abcc0afae09672e62"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "8c6e3856b12dc2bf471e8c11488dcea7"
server_key_iv: "db7f62ec23292fa2f86001f2a92f25b1"
server_key_version: "encryptionkey@0"
I20260808 05:11:10.609192 4880 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:10.620425 4880 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:10.622262 4880 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:10.622370 4880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:10.622531 4880 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:10.622773 4880 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:10.622808 4880 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.622828 4880 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:10.622843 4880 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.628121 4880 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:40093
I20260808 05:11:10.628186 5094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:40093 every 8 connection(s)
I20260808 05:11:10.628465 4880 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:11:10.633450 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 4880
I20260808 05:11:10.633766 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:42431
--local_ip_for_outbound_sockets=127.12.251.3
--tserver_master_addrs=127.12.251.62:33499
--webserver_port=40867
--webserver_interface=127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 08 05:11:10 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165870, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:10.637612 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.629135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:35921 (local address 127.12.251.62:33499)
0808 05:11:10.629183 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.629185 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.629392 (+ 207us) server_negotiation.cc:407] Connection header received
0808 05:11:10.629878 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.629879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.629896 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.629950 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:10.630861 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.631365 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.632322 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.632540 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.632594 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.634858 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:10.634859 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:10.634859 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:10.634868 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:10.636225 (+ 1357us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.636659 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.636660 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.636660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.636718 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.636949 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.636950 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.636950 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.637062 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:10.637120 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.637425 (+ 305us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.637522 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:11:10.637746 5099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.629116 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:35921)
0808 05:11:10.629282 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.629319 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.629784 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.630033 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.630037 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.630584 (+ 547us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:10.630763 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.630768 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.631453 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.631454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.632239 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.632241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.632612 (+ 371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.632613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.632732 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.633132 (+ 400us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:10.633140 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:10.634763 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:10.636310 (+ 1547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:10.636317 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:10.636320 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:10.636574 (+ 254us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:10.636771 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:10.636772 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:10.636772 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:10.636869 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:10.637120 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:10.637127 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:10.637293 (+ 166us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.637390 (+ 97us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.637540 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":68,"threads_started":1}
I20260808 05:11:10.638234 5096 heartbeater.cc:347] Connected to a master server at 127.12.251.62:33499
I20260808 05:11:10.638319 5096 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:10.638494 5096 heartbeater.cc:511] Master 127.12.251.62:33499 requested a full tablet report, sending...
I20260808 05:11:10.638875 4609 ts_manager.cc:194] Registered new tserver with Master: 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093)
I20260808 05:11:10.639356 4609 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:35921
W20260808 05:11:10.715907 5101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:10.716114 5101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:10.716136 5101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:10.717250 5101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:10.717299 5101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:10.717326 5101 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:10.718770 5101 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:42431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=40867
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:10.718963 5101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:10.719185 5101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:10.724047 5109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:10.724089 5111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:10.724157 5101 server_base.cc:1034] running on GCE node
W20260808 05:11:10.724093 5108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:10.724438 5101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:10.724658 5101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:10.725785 5101 hybrid_clock.cc:648] HybridClock initialized: now 1786165870725772 us; error 30 us; skew 500 ppm
Aug 08 05:11:10 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165870, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:10.728257 5101 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:11:10.728658 5101 webserver.cc:460] Webserver started at http://127.12.251.3:40867/ using document root <none> and password file <none>
I20260808 05:11:10.728873 5101 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:10.728941 5101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:10.730362 5101 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:10.730881 5126 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.731029 5101 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:10.731113 5101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "4c7a1647a70946b9a684db53ad235549"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "7747caa1a7ece62c391f5261e8d4793e"
server_key_iv: "6ca069dbda1cf81e229384c67859e618"
server_key_version: "encryptionkey@0"
I20260808 05:11:10.731467 5101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:10.757495 5101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:10.759743 5101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:10.759882 5101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:10.760124 5101 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:10.760423 5101 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:10.760458 5101 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.760488 5101 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:10.760504 5101 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.766120 5101 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:42431
I20260808 05:11:10.766163 5285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:42431 every 8 connection(s)
I20260808 05:11:10.766495 5101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:11:10.769739 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 5101
Aug 08 05:11:10 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165870, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:10.776211 4885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.767199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:56949 (local address 127.12.251.62:33499)
0808 05:11:10.767285 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.767287 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.767449 (+ 162us) server_negotiation.cc:407] Connection header received
0808 05:11:10.767930 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.767931 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.767942 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.767996 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:10.768894 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.769427 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.770755 (+ 1328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.770954 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.771004 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.773418 (+ 2414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:10.773419 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:10.773420 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:10.773427 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:10.774903 (+ 1476us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.775302 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.775304 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.775304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.775360 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.775599 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.775600 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.775600 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.775699 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:10.775746 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.776042 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.776120 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260808 05:11:10.776389 5291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.767175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:56949)
0808 05:11:10.767326 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.767363 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.767835 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.768053 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.768057 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.768605 (+ 548us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:10.768808 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.768814 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.769495 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.769496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.770678 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.770681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.771048 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.771049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.771187 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.771662 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:10.771672 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:10.773339 (+ 1667us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:10.774972 (+ 1633us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:10.774979 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:10.774981 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:10.775232 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:10.775420 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:10.775421 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:10.775421 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:10.775538 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:10.775754 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:10.775761 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:10.775907 (+ 146us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.776022 (+ 115us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.776166 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":87,"threads_started":1}
I20260808 05:11:10.776743 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.770155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56642 (local address 127.12.251.62:33499)
0808 05:11:10.770261 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.770262 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.770349 (+ 87us) server_negotiation.cc:407] Connection header received
0808 05:11:10.770405 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.770405 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.770414 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.770465 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:10.771122 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.771597 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.772570 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.772871 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.772940 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.774161 (+ 1221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:10.774162 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:10.774162 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:10.774170 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:10.775504 (+ 1334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.775830 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.775830 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.775831 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.775875 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.776059 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.776060 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.776060 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.776169 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:10.776341 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.776412 (+ 71us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.776487 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":54,"threads_started":1}
I20260808 05:11:10.777016 5287 heartbeater.cc:347] Connected to a master server at 127.12.251.62:33499
I20260808 05:11:10.777117 5287 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:10.777339 5287 heartbeater.cc:511] Master 127.12.251.62:33499 requested a full tablet report, sending...
I20260808 05:11:10.777715 4609 ts_manager.cc:194] Registered new tserver with Master: 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431)
I20260808 05:11:10.778057 4609 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:56949
I20260808 05:11:10.788269 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:11:10.791165 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.788664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56654 (local address 127.12.251.62:33499)
0808 05:11:10.788707 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.788709 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.788813 (+ 104us) server_negotiation.cc:407] Connection header received
0808 05:11:10.788898 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.788899 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.788947 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.789008 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:10.789127 (+ 119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.789687 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.790451 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.790662 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.790718 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.790873 (+ 155us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:10.790925 (+ 52us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0808 05:11:10.791094 (+ 169us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:56654: token expired
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 05:11:10.791213 5296 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:56654: token expired
W20260808 05:11:10.792085 4494 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.251.62:33499)
I20260808 05:11:10.797534 5296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.792353 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56660 (local address 127.12.251.62:33499)
0808 05:11:10.792390 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.792392 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.792399 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:11:10.792447 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.792448 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.792456 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.792499 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:10.792946 (+ 447us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.793448 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.794105 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.794291 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.794341 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.795382 (+ 1041us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:10.795383 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:10.795384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:10.795391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:10.796454 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.796787 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.796788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.796789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.796845 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:10.797030 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:10.797031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:10.797032 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:10.797164 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:10.797272 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.797369 (+ 97us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.797449 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:11:10.798696 4609 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56660:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:11:10.800222 4609 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:11:10.803365 4764 tablet_service.cc:1467] Processing CreateTablet for tablet 158555adf0f64fc48983c6658788d7a2 (DEFAULT_TABLE table=test-table [id=42d71871fa8a4504a371caa9bc4198c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:10.803580 4764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 158555adf0f64fc48983c6658788d7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:10.805176 4719 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Bootstrap starting.
I20260808 05:11:10.805526 4719 tablet_bootstrap.cc:654] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:10.806159 4719 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: No bootstrap required, opened a new log
I20260808 05:11:10.806203 4719 ts_tablet_manager.cc:1397] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260808 05:11:10.806322 4719 raft_consensus.cc:348] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.806387 4719 raft_consensus.cc:374] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:10.806430 4719 raft_consensus.cc:729] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987810244d46499e902e03b7dbe41344, State: Initialized, Role: FOLLOWER
I20260808 05:11:10.806473 4719 consensus_queue.cc:260] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.806560 4719 ts_tablet_manager.cc:1428] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:10.806638 4891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.803042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:42431 (local address 127.0.0.1:53778)
0808 05:11:10.803117 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.803129 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.803166 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.803776 (+ 610us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.803777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.803778 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:10.803816 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.803818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.804691 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.804692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.805522 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.805525 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.806421 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.806422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.806486 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.806490 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.806531 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.806575 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":56}
I20260808 05:11:10.806828 5300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.803162 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53778 (local address 127.12.251.3:42431)
0808 05:11:10.803611 (+ 449us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.803619 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.803629 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:11:10.803672 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.803674 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.803691 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.803762 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:10.803854 (+ 92us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.804620 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.805609 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.806355 (+ 746us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.806412 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.806472 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.806704 (+ 232us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.806751 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":411,"thread_start_us":113,"threads_started":1}
I20260808 05:11:10.807489 5302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.803431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:40093 (local address 127.0.0.1:52204)
0808 05:11:10.803591 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.803601 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.803650 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.803973 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.803974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.803976 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:10.804009 (+ 33us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.804010 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.805178 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.805179 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.806251 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.806255 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.807260 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.807261 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.807323 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.807326 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.807389 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.807426 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":83,"threads_started":1}
I20260808 05:11:10.807502 5303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.803564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52204 (local address 127.12.251.2:40093)
0808 05:11:10.803812 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.803818 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.803829 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:11:10.803869 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.803871 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.803885 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.803979 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:10.804061 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.805077 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.806330 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.807104 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.807172 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.807226 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.807399 (+ 173us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.807438 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":111,"threads_started":1}
I20260808 05:11:10.807512 5194 tablet_service.cc:1467] Processing CreateTablet for tablet 158555adf0f64fc48983c6658788d7a2 (DEFAULT_TABLE table=test-table [id=42d71871fa8a4504a371caa9bc4198c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:10.807854 5194 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 158555adf0f64fc48983c6658788d7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:10.808193 4999 tablet_service.cc:1467] Processing CreateTablet for tablet 158555adf0f64fc48983c6658788d7a2 (DEFAULT_TABLE table=test-table [id=42d71871fa8a4504a371caa9bc4198c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:10.808512 4999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 158555adf0f64fc48983c6658788d7a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:10.810746 5306 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Bootstrap starting.
I20260808 05:11:10.811322 5308 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Bootstrap starting.
I20260808 05:11:10.811506 5306 tablet_bootstrap.cc:654] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:10.811903 5308 tablet_bootstrap.cc:654] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:10.812004 5306 log.cc:824] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:10.812434 5308 log.cc:824] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:10.812697 5306 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: No bootstrap required, opened a new log
I20260808 05:11:10.812773 5306 ts_tablet_manager.cc:1397] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:10.813154 5308 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: No bootstrap required, opened a new log
I20260808 05:11:10.813210 5308 ts_tablet_manager.cc:1397] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:10.814296 5306 raft_consensus.cc:348] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.814476 5306 raft_consensus.cc:374] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:10.814517 5306 raft_consensus.cc:729] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c7a1647a70946b9a684db53ad235549, State: Initialized, Role: FOLLOWER
I20260808 05:11:10.814651 5306 consensus_queue.cc:260] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.814658 5308 raft_consensus.cc:348] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.814844 5308 raft_consensus.cc:374] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:10.814872 5308 raft_consensus.cc:729] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46cc4c6bec00433abcc0afae09672e62, State: Initialized, Role: FOLLOWER
I20260808 05:11:10.814954 5306 ts_tablet_manager.cc:1428] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:10.815006 5287 heartbeater.cc:503] Master 127.12.251.62:33499 was elected leader, sending a full tablet report...
I20260808 05:11:10.815030 5308 consensus_queue.cc:260] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.815300 5308 ts_tablet_manager.cc:1428] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:10.815308 5096 heartbeater.cc:503] Master 127.12.251.62:33499 was elected leader, sending a full tablet report...
I20260808 05:11:10.839161 5314 raft_consensus.cc:482] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:10.839278 5314 raft_consensus.cc:504] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.839643 5314 leader_election.cc:288] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093), 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201)
I20260808 05:11:10.842710 5303 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.839924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:37175 (local address 127.12.251.2:40093)
0808 05:11:10.839980 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.839982 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.840110 (+ 128us) server_negotiation.cc:407] Connection header received
0808 05:11:10.840136 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.840136 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.840147 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.840188 (+ 41us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:10.840291 (+ 103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.840993 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.841997 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.842372 (+ 375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.842434 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.842443 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.842606 (+ 163us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.842645 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:11:10.842730 5291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.839790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:42201 (local address 127.12.251.3:35891)
0808 05:11:10.839849 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.839859 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.839899 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.840072 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.840073 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.840075 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:10.840150 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.840152 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.841092 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.841094 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.841943 (+ 849us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.841945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.842486 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.842487 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.842551 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.842554 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.842602 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.842642 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":52}
I20260808 05:11:10.842729 4892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.839898 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:35891 (local address 127.12.251.1:42201)
0808 05:11:10.839948 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.839950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.839959 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:10.839987 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.839988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.839996 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.840050 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:10.840212 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.841007 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.842037 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.842403 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.842474 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.842482 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.842618 (+ 136us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.842660 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:11:10.842739 5317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.839833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:40093 (local address 127.12.251.3:37175)
0808 05:11:10.840030 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.840039 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:10.840097 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:10.840199 (+ 102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:10.840200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:10.840201 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:10.840250 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.840251 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.841072 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.841073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.841918 (+ 845us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:10.841920 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.842459 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.842460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:10.842538 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.842541 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:10.842584 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:11:10.842624 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":103,"threads_started":1}
I20260808 05:11:10.843108 5025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "158555adf0f64fc48983c6658788d7a2" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46cc4c6bec00433abcc0afae09672e62" is_pre_election: true
I20260808 05:11:10.843166 4809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "158555adf0f64fc48983c6658788d7a2" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "987810244d46499e902e03b7dbe41344" is_pre_election: true
I20260808 05:11:10.843243 5025 raft_consensus.cc:2454] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 0.
I20260808 05:11:10.843314 4809 raft_consensus.cc:2454] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 0.
I20260808 05:11:10.843490 5130 leader_election.cc:302] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46cc4c6bec00433abcc0afae09672e62, 4c7a1647a70946b9a684db53ad235549; no voters:
I20260808 05:11:10.843622 5314 raft_consensus.cc:2781] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:11:10.843678 5314 raft_consensus.cc:482] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:11:10.843695 5314 raft_consensus.cc:3037] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:10.844377 5314 raft_consensus.cc:504] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.844502 5314 leader_election.cc:288] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 election: Requested vote from peers 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093), 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201)
I20260808 05:11:10.844660 4809 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "158555adf0f64fc48983c6658788d7a2" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "987810244d46499e902e03b7dbe41344"
I20260808 05:11:10.844724 4809 raft_consensus.cc:3037] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:10.845808 4809 raft_consensus.cc:2454] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 1.
I20260808 05:11:10.845916 5025 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "158555adf0f64fc48983c6658788d7a2" candidate_uuid: "4c7a1647a70946b9a684db53ad235549" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46cc4c6bec00433abcc0afae09672e62"
I20260808 05:11:10.845963 5131 leader_election.cc:302] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c7a1647a70946b9a684db53ad235549, 987810244d46499e902e03b7dbe41344; no voters:
I20260808 05:11:10.845993 5025 raft_consensus.cc:3037] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:10.846073 5314 raft_consensus.cc:2781] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:10.846228 5314 raft_consensus.cc:686] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 1 LEADER]: Becoming Leader. State: Replica: 4c7a1647a70946b9a684db53ad235549, State: Running, Role: LEADER
I20260808 05:11:10.846315 5314 consensus_queue.cc:237] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:10.846769 5025 raft_consensus.cc:2454] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c7a1647a70946b9a684db53ad235549 in term 1.
I20260808 05:11:10.847095 4609 catalog_manager.cc:5495] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4c7a1647a70946b9a684db53ad235549 (127.12.251.3). New cstate: current_term: 1 leader_uuid: "4c7a1647a70946b9a684db53ad235549" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } health_report { overall_health: UNKNOWN } } }
I20260808 05:11:10.851418 5300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.849460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53794 (local address 127.12.251.3:42431)
0808 05:11:10.849507 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:10.849510 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:10.849538 (+ 28us) server_negotiation.cc:407] Connection header received
0808 05:11:10.849566 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:10.849567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:10.849581 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:10.849628 (+ 47us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:10.849714 (+ 86us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.850147 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.850801 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:10.851018 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:10.851074 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:10.851177 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:10.851263 (+ 86us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:11:10.851329 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:10.851341 (+ 12us) server_negotiation.cc:299] Negotiation successful
0808 05:11:10.851355 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:11:10.852885 4809 raft_consensus.cc:1261] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Refusing update from remote peer 4c7a1647a70946b9a684db53ad235549: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:10.852901 5025 raft_consensus.cc:1261] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Refusing update from remote peer 4c7a1647a70946b9a684db53ad235549: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:10.853192 5318 consensus_queue.cc:1035] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:10.853339 5314 consensus_queue.cc:1035] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:10.856110 5326 mvcc.cc:205] Tried to move back new op lower bound from 7316135407011389440 to 7316135406987255808. Current Snapshot: MvccSnapshot[applied={T|T < 7316135407011389440 or (T in {7316135407011389440})}]
I20260808 05:11:10.856578 5325 mvcc.cc:205] Tried to move back new op lower bound from 7316135407011389440 to 7316135406987255808. Current Snapshot: MvccSnapshot[applied={T|T < 7316135407011389440 or (T in {7316135407011389440})}]
I20260808 05:11:10.857359 4607 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:10.857455 4607 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:56660:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:10.858145 4607 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Sending DeleteTablet for 3 replicas of tablet 158555adf0f64fc48983c6658788d7a2
I20260808 05:11:10.858448 4764 tablet_service.cc:1514] Processing DeleteTablet for tablet 158555adf0f64fc48983c6658788d7a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:10 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:42174
I20260808 05:11:10.858495 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 4660
I20260808 05:11:10.858477 4999 tablet_service.cc:1514] Processing DeleteTablet for tablet 158555adf0f64fc48983c6658788d7a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:10 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:52204
I20260808 05:11:10.858659 4895 tablet_replica.cc:330] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: stopping tablet replica
I20260808 05:11:10.858713 4895 raft_consensus.cc:2229] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:10.858753 4895 raft_consensus.cc:2258] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:10.863143 5194 tablet_service.cc:1514] Processing DeleteTablet for tablet 158555adf0f64fc48983c6658788d7a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:10 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:53778
I20260808 05:11:10.864692 5335 tablet_replica.cc:330] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: stopping tablet replica
I20260808 05:11:10.864791 5335 raft_consensus.cc:2229] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:10.864889 5335 raft_consensus.cc:2258] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:10.866612 5335 ts_tablet_manager.cc:1905] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:10.868244 5335 ts_tablet_manager.cc:1918] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:10.868322 5335 log.cc:1196] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/158555adf0f64fc48983c6658788d7a2
I20260808 05:11:10.868592 5335 ts_tablet_manager.cc:1939] T 158555adf0f64fc48983c6658788d7a2 P 46cc4c6bec00433abcc0afae09672e62: Deleting consensus metadata
I20260808 05:11:10.868975 4586 catalog_manager.cc:4841] TS 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093): tablet 158555adf0f64fc48983c6658788d7a2 (table test-table [id=42d71871fa8a4504a371caa9bc4198c0]) successfully deleted
I20260808 05:11:10.869874 5336 tablet_replica.cc:330] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: stopping tablet replica
I20260808 05:11:10.869997 5336 raft_consensus.cc:2229] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:11:10.870093 5336 raft_consensus.cc:2258] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:10.872079 5336 ts_tablet_manager.cc:1905] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:10.874187 5336 ts_tablet_manager.cc:1918] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:10.874346 5336 log.cc:1196] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/158555adf0f64fc48983c6658788d7a2
I20260808 05:11:10.874773 5336 ts_tablet_manager.cc:1939] T 158555adf0f64fc48983c6658788d7a2 P 4c7a1647a70946b9a684db53ad235549: Deleting consensus metadata
I20260808 05:11:10.875368 4586 catalog_manager.cc:4841] TS 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431): tablet 158555adf0f64fc48983c6658788d7a2 (table test-table [id=42d71871fa8a4504a371caa9bc4198c0]) successfully deleted
W20260808 05:11:10.883420 4587 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:42201 (error 108)
I20260808 05:11:10.883872 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 4880
I20260808 05:11:10.883927 5302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:10.883779 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:42201 (local address 127.0.0.1:42186)
0808 05:11:10.883831 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:10.883889 (+ 58us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:42201: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 05:11:10.894851 4587 catalog_manager.cc:4584] TS 987810244d46499e902e03b7dbe41344 (127.12.251.1:42201): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 158555adf0f64fc48983c6658788d7a2: Network error: Client connection negotiation failed: client connection to 127.12.251.1:42201: connect: Connection refused (error 111)
I20260808 05:11:10.899662 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 5101
I20260808 05:11:10.909412 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 4557
I20260808 05:11:30.917941 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33499
--webserver_interface=127.12.251.62
--webserver_port=35451
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:33499
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:31.002275 5338 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:31.002491 5338 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:31.002513 5338 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:31.003612 5338 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260808 05:11:31.003648 5338 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260808 05:11:31.003660 5338 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260808 05:11:31.003670 5338 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:31.003682 5338 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:31.003698 5338 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:31.003710 5338 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:31.003726 5338 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:31.005147 5338 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:33499
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33499
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=35451
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5338
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:31.005365 5338 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:31.005541 5338 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:11:31.010571 5338 server_base.cc:1034] running on GCE node
W20260808 05:11:31.010540 5346 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:31.010542 5345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:31.010540 5348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:31.011145 5338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:31.011417 5338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:31.012574 5338 hybrid_clock.cc:648] HybridClock initialized: now 1786165891012562 us; error 29 us; skew 500 ppm
Aug 08 05:11:31 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165891, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:31.015125 5338 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:11:31.015522 5338 webserver.cc:460] Webserver started at http://127.12.251.62:35451/ using document root <none> and password file <none>
I20260808 05:11:31.015740 5338 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:31.015789 5338 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:31.017066 5338 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:31.017761 5358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.017932 5338 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.018006 5338 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "15862a148546475db5f929bfb9a1cab6"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "06b472145a82a538fccfb668e39ee659"
server_key_iv: "8871bd237a43140ba3ba50de5740ecd5"
server_key_version: "encryptionkey@0"
I20260808 05:11:31.018342 5338 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:31.029516 5338 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:31.031491 5338 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:31.031620 5338 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:31.035457 5338 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:33499
I20260808 05:11:31.035501 5428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:33499 every 8 connection(s)
I20260808 05:11:31.035836 5338 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:31.037268 5429 sys_catalog.cc:263] Verifying existing consensus state
I20260808 05:11:31.037896 5429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Bootstrap starting.
I20260808 05:11:31.044068 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 5338
I20260808 05:11:31.044323 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:42201
--local_ip_for_outbound_sockets=127.12.251.1
--tserver_master_addrs=127.12.251.62:33499
--webserver_port=40705
--webserver_interface=127.12.251.1
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:11:31.046584 5429 log.cc:824] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:31.049394 5429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:11:31.049734 5429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Bootstrap complete.
I20260808 05:11:31.052873 5429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:31.053190 5429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 15862a148546475db5f929bfb9a1cab6, State: Initialized, Role: FOLLOWER
I20260808 05:11:31.053390 5429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:31.053472 5429 raft_consensus.cc:388] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:31.053534 5429 raft_consensus.cc:482] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:31.053586 5429 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 2 FOLLOWER]: Advancing to term 3
I20260808 05:11:31.054945 5429 raft_consensus.cc:504] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:31.055058 5429 leader_election.cc:302] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 15862a148546475db5f929bfb9a1cab6; no voters:
I20260808 05:11:31.055234 5429 leader_election.cc:288] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260808 05:11:31.055285 5435 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 3 FOLLOWER]: Leader election won for term 3
I20260808 05:11:31.055447 5435 raft_consensus.cc:686] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [term 3 LEADER]: Becoming Leader. State: Replica: 15862a148546475db5f929bfb9a1cab6, State: Running, Role: LEADER
I20260808 05:11:31.055491 5429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:31.055580 5435 consensus_queue.cc:237] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } }
I20260808 05:11:31.055958 5439 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 15862a148546475db5f929bfb9a1cab6. Latest consensus state: current_term: 3 leader_uuid: "15862a148546475db5f929bfb9a1cab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } } }
I20260808 05:11:31.056102 5439 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:31.055949 5437 sys_catalog.cc:455] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "15862a148546475db5f929bfb9a1cab6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "15862a148546475db5f929bfb9a1cab6" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33499 } } }
I20260808 05:11:31.056279 5437 sys_catalog.cc:458] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:31.056718 5449 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:31.057523 5449 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:31.057631 5449 catalog_manager.cc:1259] Loaded cluster ID: 19688b543e8c47d2a5ed2c73ad24ab76
I20260808 05:11:31.057663 5449 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:31.058764 5449 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:31.058969 5449 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Loaded TSK: 0
I20260808 05:11:31.059020 5449 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 15862a148546475db5f929bfb9a1cab6: Loaded TSK: 1
F20260808 05:11:31.059250 5449 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7ff27c5539ad google::LogMessage::Fail() at ??:0
@ 0x7ff27c55688a google::LogMessage::SendToLog() at ??:0
@ 0x7ff27c5534de google::LogMessage::Flush() at ??:0
@ 0x7ff27c554a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7ff27ecc0104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7ff27ecbdd41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7ff2844ad1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7ff2844ad48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7ff2844ad594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7ff284473c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7ff28447dad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7ff27e4210d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7ff27e416954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7ff27f27a6db start_thread at ??:0
@ 0x7ff27b05161f clone at ??:0
W20260808 05:11:31.139573 5433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:31.139775 5433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:31.139807 5433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:31.141033 5433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:31.141079 5433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:31.141122 5433 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:31.142674 5433 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:42201
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=40705
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5433
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:31.142912 5433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:31.143173 5433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:31.149315 5492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:31.149312 5493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:31.149627 5496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:31.149722 5433 server_base.cc:1034] running on GCE node
I20260808 05:11:31.149991 5433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:31.150277 5433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:31.151482 5433 hybrid_clock.cc:648] HybridClock initialized: now 1786165891151460 us; error 40 us; skew 500 ppm
Aug 08 05:11:31 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165891, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:31.153879 5433 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:11:31.154320 5433 webserver.cc:460] Webserver started at http://127.12.251.1:40705/ using document root <none> and password file <none>
I20260808 05:11:31.154548 5433 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:31.154598 5433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:31.155911 5433 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:31.156575 5506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.156737 5433 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:31.156821 5433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "987810244d46499e902e03b7dbe41344"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "e142e143882e1d8f3955f83da7f64257"
server_key_iv: "317556324cb491080612c23a5ab5c13b"
server_key_version: "encryptionkey@0"
I20260808 05:11:31.157146 5433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:31.178331 5433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:31.180472 5433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:31.180624 5433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:31.180850 5433 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:31.181304 5515 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260808 05:11:31.183359 5433 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260808 05:11:31.183418 5433 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260808 05:11:31.183455 5433 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260808 05:11:31.184150 5433 ts_tablet_manager.cc:610] Registered 1 tablets
I20260808 05:11:31.184185 5433 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260808 05:11:31.184278 5515 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Bootstrap starting.
I20260808 05:11:31.191414 5433 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:42201
I20260808 05:11:31.191493 5674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:42201 every 8 connection(s)
I20260808 05:11:31.191826 5433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:11:31.195657 5515 log.cc:824] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:31.198467 5515 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260808 05:11:31.198781 5515 tablet_bootstrap.cc:492] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Bootstrap complete.
I20260808 05:11:31.199934 5515 ts_tablet_manager.cc:1397] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.010s
I20260808 05:11:31.201105 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 5433
I20260808 05:11:31.201398 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:40093
--local_ip_for_outbound_sockets=127.12.251.2
--tserver_master_addrs=127.12.251.62:33499
--webserver_port=43177
--webserver_interface=127.12.251.2
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:11:31.201360 5515 raft_consensus.cc:348] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:31.201704 5515 raft_consensus.cc:729] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 987810244d46499e902e03b7dbe41344, State: Initialized, Role: FOLLOWER
I20260808 05:11:31.201854 5515 consensus_queue.cc:260] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:31.202131 5515 ts_tablet_manager.cc:1428] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
W20260808 05:11:31.266636 5680 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:11:31.192474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:55563)
0808 05:11:31.192652 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.192697 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:31.193150 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:31.266424 (+ 73274us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":85,"threads_started":1}
W20260808 05:11:31.266902 5677 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:33499 (0 consecutive failures): Network error: Failed to ping master at 127.12.251.62:33499: Client connection negotiation failed: client connection to 127.12.251.62:33499: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260808 05:11:31.267251 5680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.267138 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:50833)
0808 05:11:31.267185 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.267226 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:11:31.267562 5680 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.267480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:46197)
0808 05:11:31.267516 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.267539 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 05:11:31.267670 5677 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260808 05:11:31.290529 5684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:31.290733 5684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:31.290764 5684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:31.291906 5684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:31.291951 5684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:31.291986 5684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:31.293485 5684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:40093
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=43177
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:31.293721 5684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:31.293934 5684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:31.298764 5696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:31.298791 5693 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:31.298833 5684 server_base.cc:1034] running on GCE node
W20260808 05:11:31.298803 5692 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:31.299186 5684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:31.299438 5684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:31.300582 5684 hybrid_clock.cc:648] HybridClock initialized: now 1786165891300573 us; error 39 us; skew 500 ppm
Aug 08 05:11:31 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165891, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:31.303050 5684 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:11:31.303484 5684 webserver.cc:460] Webserver started at http://127.12.251.2:43177/ using document root <none> and password file <none>
I20260808 05:11:31.303709 5684 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:31.303759 5684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:31.305013 5684 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:31.305583 5708 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.305724 5684 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.305799 5684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "46cc4c6bec00433abcc0afae09672e62"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "8c6e3856b12dc2bf471e8c11488dcea7"
server_key_iv: "db7f62ec23292fa2f86001f2a92f25b1"
server_key_version: "encryptionkey@0"
I20260808 05:11:31.306131 5684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:31.321179 5684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:31.323031 5684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:31.323177 5684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:31.323405 5684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:31.323710 5684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:31.323745 5684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.323774 5684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:31.323797 5684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.329443 5684 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:40093
I20260808 05:11:31.329510 5865 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:40093 every 8 connection(s)
I20260808 05:11:31.329864 5684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:11:31.330886 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.330490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:48697)
0808 05:11:31.330666 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.330739 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
W20260808 05:11:31.331260 5866 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:33499 (0 consecutive failures): Network error: Failed to ping master at 127.12.251.62:33499: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
I20260808 05:11:31.331588 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.331504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:51005)
0808 05:11:31.331546 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.331569 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:11:31.331837 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.331768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:40645)
0808 05:11:31.331802 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.331823 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 05:11:31.331928 5866 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:11:31.338974 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 5684
I20260808 05:11:31.339252 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:42431
--local_ip_for_outbound_sockets=127.12.251.3
--tserver_master_addrs=127.12.251.62:33499
--webserver_port=40867
--webserver_interface=127.12.251.3
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34975
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:31.421625 5869 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:31.421818 5869 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:31.421840 5869 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:31.422895 5869 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:31.422926 5869 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:31.422950 5869 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:31.424296 5869 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34975
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:42431
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=40867
--tserver_master_addrs=127.12.251.62:33499
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5869
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:31.424500 5869 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:31.424685 5869 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:31.429385 5875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:31.429385 5874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:31.429445 5879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:31.429559 5869 server_base.cc:1034] running on GCE node
I20260808 05:11:31.429814 5869 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:31.430016 5869 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:31.431166 5869 hybrid_clock.cc:648] HybridClock initialized: now 1786165891431144 us; error 35 us; skew 500 ppm
Aug 08 05:11:31 dist-test-slave-bndk krb5kdc[3704](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165891, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:31.433652 5869 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:11:31.434089 5869 webserver.cc:460] Webserver started at http://127.12.251.3:40867/ using document root <none> and password file <none>
I20260808 05:11:31.434293 5869 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:31.434336 5869 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:31.435667 5869 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:31.436357 5887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.436547 5869 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:31.436655 5869 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "4c7a1647a70946b9a684db53ad235549"
format_stamp: "Formatted at 2026-08-08 05:10:49 on dist-test-slave-bndk"
server_key: "7747caa1a7ece62c391f5261e8d4793e"
server_key_iv: "6ca069dbda1cf81e229384c67859e618"
server_key_version: "encryptionkey@0"
I20260808 05:11:31.437002 5869 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:31.447252 5869 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:31.448961 5869 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:31.449088 5869 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:31.449321 5869 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:31.449620 5869 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:31.449652 5869 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.449680 5869 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:31.449704 5869 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:31.455147 5869 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:42431
I20260808 05:11:31.455202 6051 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:42431 every 8 connection(s)
I20260808 05:11:31.455507 5869 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:11:31.456506 6054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.456127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:60137)
0808 05:11:31.456295 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.456364 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":88,"threads_started":1}
W20260808 05:11:31.456875 6052 heartbeater.cc:644] Failed to heartbeat to 127.12.251.62:33499 (0 consecutive failures): Network error: Failed to ping master at 127.12.251.62:33499: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
I20260808 05:11:31.457126 6054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.457047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:34291)
0808 05:11:31.457084 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.457109 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 05:11:31.457432 6054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:31.457344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:54797)
0808 05:11:31.457381 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:31.457404 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 05:11:31.457531 6052 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260808 05:11:31.465039 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 5869
I20260808 05:11:32.268154 6056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:32.267944 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:60781)
0808 05:11:32.268057 (+ 113us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:32.268085 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":64,"threads_started":1}
I20260808 05:11:32.332405 6057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:32.332190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:53515)
0808 05:11:32.332320 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:32.332351 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":55,"threads_started":1}
I20260808 05:11:32.458032 6058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:32.457832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:37241)
0808 05:11:32.457943 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:32.457976 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96,"thread_start_us":58,"threads_started":1}
I20260808 05:11:32.479485 6059 raft_consensus.cc:482] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:32.479630 6059 raft_consensus.cc:504] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:32.479987 6059 leader_election.cc:288] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431), 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093)
Aug 08 05:11:32 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165891, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.2@KRBTEST.COM
Aug 08 05:11:32 dist-test-slave-bndk krb5kdc[3704](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165891, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.3@KRBTEST.COM
I20260808 05:11:32.489971 6063 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:32.480297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:41731 (local address 127.12.251.3:42431)
0808 05:11:32.480440 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:32.480454 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:32.480492 (+ 38us) server_negotiation.cc:407] Connection header received
0808 05:11:32.480982 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:32.480985 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:32.481029 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:32.481146 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:32.481933 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.482810 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.483758 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.484138 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.484234 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:32.486936 (+ 2702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:32.486939 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:32.486940 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:32.486949 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:32.488538 (+ 1589us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:32.488872 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:32.488876 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:32.488876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:32.488984 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:32.489178 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:32.489179 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:32.489180 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:32.489448 (+ 268us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:32.489554 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:32.489738 (+ 184us) server_negotiation.cc:299] Negotiation successful
0808 05:11:32.489860 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":50,"threads_started":1}
I20260808 05:11:32.489991 6056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:32.480146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:42431 (local address 127.12.251.1:41731)
0808 05:11:32.480219 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:32.480234 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:32.480321 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:32.481236 (+ 915us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:32.481239 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:32.481618 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:32.481806 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:32.481812 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.482901 (+ 1089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.482902 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:32.483672 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:32.483674 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.484217 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.484218 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:32.484340 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:32.484882 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:32.484892 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:32.486840 (+ 1948us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:32.488603 (+ 1763us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:32.488604 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:32.488604 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:32.488793 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:32.489050 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:32.489051 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:32.489051 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:32.489115 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:32.489536 (+ 421us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:32.489536 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:32.489587 (+ 51us) client_negotiation.cc:769] Sending connection context
0808 05:11:32.489676 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:11:32.489858 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48,"mutex_wait_us":3}
I20260808 05:11:32.490003 6064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:32.480387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:39549 (local address 127.12.251.2:40093)
0808 05:11:32.480560 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:32.480569 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:32.480596 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:11:32.481023 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:32.481025 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:32.481062 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:32.481188 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:32.481918 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.482778 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.483757 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.484137 (+ 380us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.484234 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:32.486606 (+ 2372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:32.486611 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:32.486611 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:32.486624 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:32.488330 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:32.488708 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:32.488711 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:32.488712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:32.488815 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:32.489068 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:32.489069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:32.489069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:32.489369 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:32.489429 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:32.489743 (+ 314us) server_negotiation.cc:299] Negotiation successful
0808 05:11:32.489861 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":90,"threads_started":1}
I20260808 05:11:32.490058 6062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:32.480262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:40093 (local address 127.12.251.1:39549)
0808 05:11:32.480382 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:32.480391 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:32.480443 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:32.481239 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:32.481241 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:32.481617 (+ 376us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:32.481807 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:32.481812 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.482878 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.482879 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:32.483673 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:32.483676 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:32.484219 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:32.484220 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:32.484339 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:32.484892 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:32.484896 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:32.486506 (+ 1610us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:32.488408 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:32.488414 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:32.488416 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:32.488635 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:32.488885 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:32.488886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:32.488886 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:32.489012 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:32.489429 (+ 417us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:32.489436 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:32.489585 (+ 149us) client_negotiation.cc:769] Sending connection context
0808 05:11:32.489675 (+ 90us) client_negotiation.cc:240] Negotiation successful
0808 05:11:32.489930 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"mutex_wait_us":176,"thread_start_us":58,"threads_started":1}
W20260808 05:11:32.490854 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
W20260808 05:11:32.490949 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
I20260808 05:11:32.490981 5510 leader_election.cc:302] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 987810244d46499e902e03b7dbe41344; no voters: 46cc4c6bec00433abcc0afae09672e62, 4c7a1647a70946b9a684db53ad235549
I20260808 05:11:32.491079 6059 raft_consensus.cc:2726] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:11:33.268733 6065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:33.268526 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:32881)
0808 05:11:33.268649 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:33.268685 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":59,"threads_started":1}
I20260808 05:11:33.332971 6066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:33.332796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:48653)
0808 05:11:33.332900 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:33.332931 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90,"thread_start_us":57,"threads_started":1}
I20260808 05:11:33.458582 6067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:33.458390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:55279)
0808 05:11:33.458518 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:33.458547 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":75,"threads_started":1}
I20260808 05:11:34.269398 6071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:34.269148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:52753)
0808 05:11:34.269303 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:34.269348 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260808 05:11:34.333621 6072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:34.333386 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:33303)
0808 05:11:34.333535 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:34.333573 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":83,"threads_started":1}
I20260808 05:11:34.459203 6073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:34.459007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:48721)
0808 05:11:34.459125 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:34.459160 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
I20260808 05:11:34.635880 6075 raft_consensus.cc:482] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:34.635973 6075 raft_consensus.cc:504] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:34.636129 6075 leader_election.cc:288] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431), 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093)
W20260808 05:11:34.636512 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
W20260808 05:11:34.636591 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
I20260808 05:11:34.636620 5510 leader_election.cc:302] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 987810244d46499e902e03b7dbe41344; no voters: 46cc4c6bec00433abcc0afae09672e62, 4c7a1647a70946b9a684db53ad235549
I20260808 05:11:34.636703 6075 raft_consensus.cc:2726] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:11:35.270035 6076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:35.269802 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:34001)
0808 05:11:35.269951 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:35.269987 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260808 05:11:35.334296 6077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:35.334072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:34377)
0808 05:11:35.334214 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:35.334255 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
I20260808 05:11:35.459841 6079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:35.459637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:49773)
0808 05:11:35.459763 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:35.459798 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":70,"threads_started":1}
I20260808 05:11:36.270736 6083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:36.270493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:59553)
0808 05:11:36.270647 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:36.270687 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":62,"threads_started":1}
I20260808 05:11:36.334918 6085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:36.334713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:38525)
0808 05:11:36.334839 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:36.334876 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":78,"threads_started":1}
I20260808 05:11:36.460402 6086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:36.460197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:57917)
0808 05:11:36.460324 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:36.460356 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260808 05:11:37.271392 6088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:37.271166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:58575)
0808 05:11:37.271311 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:37.271345 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260808 05:11:37.335543 6090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:37.335312 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:42279)
0808 05:11:37.335454 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:37.335488 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260808 05:11:37.461027 6091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:37.460813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:56225)
0808 05:11:37.460948 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:37.460984 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
I20260808 05:11:37.998400 6092 raft_consensus.cc:482] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:37.998502 6092 raft_consensus.cc:504] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:37.998636 6092 leader_election.cc:288] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431), 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093)
W20260808 05:11:37.999060 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
W20260808 05:11:37.999143 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
I20260808 05:11:37.999167 5510 leader_election.cc:302] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 987810244d46499e902e03b7dbe41344; no voters: 46cc4c6bec00433abcc0afae09672e62, 4c7a1647a70946b9a684db53ad235549
I20260808 05:11:37.999248 6092 raft_consensus.cc:2726] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:11:38.272006 6097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:38.271783 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:57923)
0808 05:11:38.271910 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:38.271956 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260808 05:11:38.336212 6098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:38.335987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:36051)
0808 05:11:38.336123 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:38.336169 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260808 05:11:38.461628 6099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:38.461389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:46619)
0808 05:11:38.461551 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:38.461585 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":95,"threads_started":1}
I20260808 05:11:39.272619 6100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:39.272409 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:52935)
0808 05:11:39.272534 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:39.272570 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260808 05:11:39.336853 6101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:39.336637 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:46865)
0808 05:11:39.336771 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:39.336803 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":57,"threads_started":1}
I20260808 05:11:39.462255 6102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:39.462060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:55225)
0808 05:11:39.462179 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:39.462212 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260808 05:11:40.273234 6103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:40.273014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:44019)
0808 05:11:40.273135 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:40.273170 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":57,"threads_started":1}
I20260808 05:11:40.337491 6105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:40.337305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:55563)
0808 05:11:40.337413 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:40.337446 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":60,"threads_started":1}
I20260808 05:11:40.462921 6107 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:40.462707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:49683)
0808 05:11:40.462846 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:40.462877 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260808 05:11:41.273941 6108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:41.273730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:52997)
0808 05:11:41.273852 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:41.273892 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":63,"threads_started":1}
I20260808 05:11:41.289978 6109 raft_consensus.cc:482] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:41.290091 6109 raft_consensus.cc:504] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:41.290220 6109 leader_election.cc:288] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431), 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093)
W20260808 05:11:41.290577 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
W20260808 05:11:41.290660 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
I20260808 05:11:41.290681 5510 leader_election.cc:302] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 987810244d46499e902e03b7dbe41344; no voters: 46cc4c6bec00433abcc0afae09672e62, 4c7a1647a70946b9a684db53ad235549
I20260808 05:11:41.290769 6109 raft_consensus.cc:2726] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:11:41.338141 6110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:41.337874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:46775)
0808 05:11:41.338038 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:41.338077 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":97,"threads_started":1}
I20260808 05:11:41.463627 6113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:41.463371 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:60639)
0808 05:11:41.463536 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:41.463578 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":94,"threads_started":1}
I20260808 05:11:42.274602 6116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:42.274350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:52403)
0808 05:11:42.274517 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:42.274552 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":101,"threads_started":1}
I20260808 05:11:42.338750 6117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:42.338534 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:33409)
0808 05:11:42.338667 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:42.338706 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":58,"threads_started":1}
I20260808 05:11:42.464285 6121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:42.464046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:43771)
0808 05:11:42.464197 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:42.464239 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":75,"threads_started":1}
I20260808 05:11:43.275204 6122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:43.274987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:51255)
0808 05:11:43.275122 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:43.275156 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260808 05:11:43.339396 6125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:43.339172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:48953)
0808 05:11:43.339312 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:43.339349 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260808 05:11:43.464970 6127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:43.464727 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:41551)
0808 05:11:43.464879 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:43.464922 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":67,"threads_started":1}
I20260808 05:11:44.275853 6128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:44.275625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:50293)
0808 05:11:44.275765 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:44.275805 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260808 05:11:44.340065 6130 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:44.339865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:33855)
0808 05:11:44.339980 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:44.340016 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":60,"threads_started":1}
I20260808 05:11:44.465699 6133 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:44.465452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:36457)
0808 05:11:44.465607 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:44.465649 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":63,"threads_started":1}
I20260808 05:11:45.276510 6134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:45.276282 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:51105)
0808 05:11:45.276424 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:45.276460 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":61,"threads_started":1}
I20260808 05:11:45.340719 6135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:45.340506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:36567)
0808 05:11:45.340627 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:45.340669 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260808 05:11:45.466341 6137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:45.466111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:35607)
0808 05:11:45.466256 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:45.466292 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":80,"threads_started":1}
I20260808 05:11:45.492481 6138 raft_consensus.cc:482] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:45.492587 6138 raft_consensus.cc:504] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4c7a1647a70946b9a684db53ad235549" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 42431 } } peers { permanent_uuid: "46cc4c6bec00433abcc0afae09672e62" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 40093 } } peers { permanent_uuid: "987810244d46499e902e03b7dbe41344" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 42201 } }
I20260808 05:11:45.492753 6138 leader_election.cc:288] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431), 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093)
W20260808 05:11:45.493186 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4c7a1647a70946b9a684db53ad235549 (127.12.251.3:42431): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
W20260808 05:11:45.493296 5510 leader_election.cc:341] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 46cc4c6bec00433abcc0afae09672e62 (127.12.251.2:40093): Not found: Tablet not found: 158555adf0f64fc48983c6658788d7a2
I20260808 05:11:45.493322 5510 leader_election.cc:302] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 987810244d46499e902e03b7dbe41344; no voters: 46cc4c6bec00433abcc0afae09672e62, 4c7a1647a70946b9a684db53ad235549
I20260808 05:11:45.493454 6138 raft_consensus.cc:2726] T 158555adf0f64fc48983c6658788d7a2 P 987810244d46499e902e03b7dbe41344 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260808 05:11:46.277166 6139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:46.276980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.1:58191)
0808 05:11:46.277090 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:46.277120 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":63,"threads_started":1}
I20260808 05:11:46.341427 6140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:46.341174 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.2:38261)
0808 05:11:46.341334 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:46.341378 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
I20260808 05:11:46.467106 6142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:46.466880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:33499 (local address 127.12.251.3:59635)
0808 05:11:46.467016 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:46.467049 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.62:33499: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":67,"threads_started":1}
I20260808 05:11:46.470072 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 5433
I20260808 05:11:46.483676 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 5684
I20260808 05:11:46.493579 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 5869
2026-08-08T05:11:46Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58427 ms)
[----------] 30 tests from SecurityITest (229785 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:11:46 dist-test-slave-bndk krb5kdc[6150](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:11:46 dist-test-slave-bndk krb5kdc[6150](info): set up 2 sockets
Aug 08 05:11:46 dist-test-slave-bndk krb5kdc[6150](info): commencing operation
krb5kdc: starting...
W20260808 05:11:47.631367 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:11:47 dist-test-slave-bndk krb5kdc[6150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:11:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:11:47.749117 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:34387
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:34387
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:47.830777 6167 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:47.830977 6167 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:47.830998 6167 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:47.832111 6167 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:47.832151 6167 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:47.832165 6167 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:47.832175 6167 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:47.832188 6167 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:47.833698 6167 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:34387
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:34387
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6167
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:47.833917 6167 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:47.834147 6167 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:47.838963 6182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:47.838967 6175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:47.838979 6167 server_base.cc:1034] running on GCE node
W20260808 05:11:47.839131 6176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:47.839413 6167 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:47.839687 6167 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:47.840824 6167 hybrid_clock.cc:648] HybridClock initialized: now 1786165907840807 us; error 29 us; skew 500 ppm
Aug 08 05:11:47 dist-test-slave-bndk krb5kdc[6150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165907, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:47.843217 6167 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:11:47.843649 6167 webserver.cc:460] Webserver started at http://127.12.251.62:38141/ using document root <none> and password file <none>
I20260808 05:11:47.843899 6167 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:47.843958 6167 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:47.844126 6167 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:47.845130 6167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30"
format_stamp: "Formatted at 2026-08-08 05:11:47 on dist-test-slave-bndk"
server_key: "6aec06aec14e5055a9b9afd22f8608b4"
server_key_iv: "a0f8630a1ee926b6eb7219b52bcf1cb6"
server_key_version: "encryptionkey@0"
I20260808 05:11:47.845492 6167 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30"
format_stamp: "Formatted at 2026-08-08 05:11:47 on dist-test-slave-bndk"
server_key: "6aec06aec14e5055a9b9afd22f8608b4"
server_key_iv: "a0f8630a1ee926b6eb7219b52bcf1cb6"
server_key_version: "encryptionkey@0"
I20260808 05:11:47.846714 6167 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:47.847369 6191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:47.847523 6167 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:47.847609 6167 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30"
format_stamp: "Formatted at 2026-08-08 05:11:47 on dist-test-slave-bndk"
server_key: "6aec06aec14e5055a9b9afd22f8608b4"
server_key_iv: "a0f8630a1ee926b6eb7219b52bcf1cb6"
server_key_version: "encryptionkey@0"
I20260808 05:11:47.847675 6167 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:47.858064 6167 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:47.859628 6167 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:47.859755 6167 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:47.863641 6167 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:34387
I20260808 05:11:47.863674 6265 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:34387 every 8 connection(s)
I20260808 05:11:47.864032 6167 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:47.864883 6266 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:47.867194 6266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30: Bootstrap starting.
I20260808 05:11:47.867758 6266 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:47.868031 6266 log.cc:824] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:47.868683 6266 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30: No bootstrap required, opened a new log
I20260808 05:11:47.870340 6266 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 34387 } }
I20260808 05:11:47.870488 6266 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:47.870512 6266 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30, State: Initialized, Role: FOLLOWER
I20260808 05:11:47.870651 6266 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 34387 } }
I20260808 05:11:47.870713 6266 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:47.870735 6266 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:47.870780 6266 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:47.871282 6266 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 34387 } }
I20260808 05:11:47.871392 6266 leader_election.cc:302] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30; no voters:
I20260808 05:11:47.871555 6266 leader_election.cc:288] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:47.871590 6270 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:47.871742 6270 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [term 1 LEADER]: Becoming Leader. State: Replica: 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30, State: Running, Role: LEADER
I20260808 05:11:47.871800 6266 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:47.871833 6270 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 34387 } }
I20260808 05:11:47.872246 6274 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30. Latest consensus state: current_term: 1 leader_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 34387 } } }
I20260808 05:11:47.872327 6274 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:47.872471 6273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cc3842d8a6d4a4bb5c7a8b3a8eb8d30" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 34387 } } }
I20260808 05:11:47.872538 6283 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:47.872602 6273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:47.873235 6283 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:47.874003 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 6167
I20260808 05:11:47.874100 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:47.874279 13292 external_mini_cluster.cc:1428] Setting key 40c62c84eb647a7f839385f805ac229e
I20260808 05:11:47.875072 6283 catalog_manager.cc:1347] Generated new cluster ID: 425584a182e848b0995e208a66fc6889
I20260808 05:11:47.875125 6283 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:11:47 dist-test-slave-bndk krb5kdc[6150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165907, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:47.885624 6299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:47.874908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33362 (local address 127.12.251.62:34387)
0808 05:11:47.875064 (+ 156us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:47.875073 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:47.875106 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:11:47.875223 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:47.875230 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:47.875285 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:47.875411 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:47.876162 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:47.877551 (+ 1389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:47.878622 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:47.879213 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:47.879309 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:47.882014 (+ 2705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:47.882019 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:47.882020 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:47.882032 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:47.883945 (+ 1913us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:47.884342 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:47.884345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:47.884346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:47.884446 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:47.884653 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:47.884654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:47.884654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:47.884956 (+ 302us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:47.885104 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:47.885245 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 05:11:47.885386 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":84,"threads_started":1}
I20260808 05:11:47.891983 6283 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:47.892467 6283 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:47.898882 6283 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30: Generated new TSK 0
I20260808 05:11:47.899039 6283 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:11:47.926158 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:34387
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:48.007071 6305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:48.007268 6305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:48.007298 6305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:48.008455 6305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:48.008498 6305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:48.008533 6305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:48.009982 6305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:34387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6305
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:48.010221 6305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:48.010424 6305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:48.015130 6315 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.015162 6320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.015161 6313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.015475 6305 server_base.cc:1034] running on GCE node
I20260808 05:11:48.015661 6305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:48.015865 6305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:48.017009 6305 hybrid_clock.cc:648] HybridClock initialized: now 1786165908016989 us; error 26 us; skew 500 ppm
Aug 08 05:11:48 dist-test-slave-bndk krb5kdc[6150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:48.019366 6305 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:11:48.019779 6305 webserver.cc:460] Webserver started at http://127.12.251.1:38593/ using document root <none> and password file <none>
I20260808 05:11:48.019971 6305 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:48.020032 6305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:48.020159 6305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:48.021155 6305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "ea708b31d81b456e9e98ba37958dd097"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "334c69b7f8a22044a6851010addc6e76"
server_key_iv: "89652fc37773960f9bf90f8ee241c40e"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.021529 6305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "ea708b31d81b456e9e98ba37958dd097"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "334c69b7f8a22044a6851010addc6e76"
server_key_iv: "89652fc37773960f9bf90f8ee241c40e"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.022733 6305 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:48.023391 6330 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.023578 6305 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:48.023664 6305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "ea708b31d81b456e9e98ba37958dd097"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "334c69b7f8a22044a6851010addc6e76"
server_key_iv: "89652fc37773960f9bf90f8ee241c40e"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.023718 6305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:48.036194 6305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:48.038005 6305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:48.038113 6305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:48.038291 6305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:48.038542 6305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:48.038571 6305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.038590 6305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:48.038606 6305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.044034 6305 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33325
I20260808 05:11:48.044114 6496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33325 every 8 connection(s)
I20260808 05:11:48.044384 6305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:11:48 dist-test-slave-bndk krb5kdc[6150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:48.050969 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 6305
I20260808 05:11:48.051079 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:11:48.051317 13292 external_mini_cluster.cc:1428] Setting key 1966439dd2880a6e8caf3a3a87f6445c
I20260808 05:11:48.053139 6299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.045061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:57981 (local address 127.12.251.62:34387)
0808 05:11:48.045112 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.045115 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.045287 (+ 172us) server_negotiation.cc:407] Connection header received
0808 05:11:48.045795 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.045796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.045810 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.045858 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:48.046776 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.047277 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.048216 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.048423 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.048480 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.050471 (+ 1991us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:48.050472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:48.050472 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:48.050479 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:48.051857 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.052261 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.052262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.052262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.052322 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.052539 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.052540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.052540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.052649 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:48.052706 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.052949 (+ 243us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.053048 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:11:48.053303 6499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.044981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:34387 (local address 127.12.251.1:57981)
0808 05:11:48.045154 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.045197 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.045701 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.045940 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.045944 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.046499 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:48.046683 (+ 184us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.046688 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.047360 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.047361 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.048136 (+ 775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.048139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.048494 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.048494 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.048613 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.048998 (+ 385us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:48.049006 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:48.050392 (+ 1386us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:48.051930 (+ 1538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:48.051937 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:48.051939 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:48.052156 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:48.052376 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:48.052376 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:48.052377 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:48.052474 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:48.052702 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:48.052709 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:48.052833 (+ 124us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.052915 (+ 82us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.053071 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":83,"threads_started":1}
I20260808 05:11:48.053705 6497 heartbeater.cc:347] Connected to a master server at 127.12.251.62:34387
I20260808 05:11:48.053795 6497 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:48.053959 6497 heartbeater.cc:511] Master 127.12.251.62:34387 requested a full tablet report, sending...
I20260808 05:11:48.054426 6217 ts_manager.cc:194] Registered new tserver with Master: ea708b31d81b456e9e98ba37958dd097 (127.12.251.1:33325)
I20260808 05:11:48.055001 6217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:57981
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:11:48.075636 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:34387
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:48.156590 6507 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:48.156792 6507 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:48.156814 6507 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:48.157987 6507 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:48.158028 6507 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:48.158056 6507 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:48.159487 6507 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:34387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6507
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:48.159704 6507 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:48.159933 6507 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:48.164738 6519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.164747 6521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.164783 6523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.164784 6507 server_base.cc:1034] running on GCE node
I20260808 05:11:48.165076 6507 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:48.165323 6507 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:48.166476 6507 hybrid_clock.cc:648] HybridClock initialized: now 1786165908166446 us; error 42 us; skew 500 ppm
Aug 08 05:11:48 dist-test-slave-bndk krb5kdc[6150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:48.168917 6507 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:11:48.169330 6507 webserver.cc:460] Webserver started at http://127.12.251.2:46319/ using document root <none> and password file <none>
I20260808 05:11:48.169531 6507 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:48.169571 6507 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:48.169664 6507 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:48.170661 6507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "484cdab617c840d0a2f5a45021d9a319"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "052740aa40f5310676de838377d08d03"
server_key_iv: "0bfd2394573b8b21af25391996bdad40"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.170943 6507 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "484cdab617c840d0a2f5a45021d9a319"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "052740aa40f5310676de838377d08d03"
server_key_iv: "0bfd2394573b8b21af25391996bdad40"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.172290 6507 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:48.172955 6536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.173092 6507 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:48.173168 6507 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "484cdab617c840d0a2f5a45021d9a319"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "052740aa40f5310676de838377d08d03"
server_key_iv: "0bfd2394573b8b21af25391996bdad40"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.173261 6507 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:48.187614 6507 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:48.189656 6507 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:48.189782 6507 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:48.189975 6507 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:48.190259 6507 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:48.190292 6507 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.190312 6507 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:48.190335 6507 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.195657 6507 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:35661
I20260808 05:11:48.195739 6696 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:35661 every 8 connection(s)
I20260808 05:11:48.195986 6507 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:11:48.200434 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 6507
I20260808 05:11:48.200546 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:11:48.200724 13292 external_mini_cluster.cc:1428] Setting key 2f0d6a806adf1b2c5cf4a9a95dfaa729
Aug 08 05:11:48 dist-test-slave-bndk krb5kdc[6150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:48.204941 6299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.196718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:49133 (local address 127.12.251.62:34387)
0808 05:11:48.196803 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.196805 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.196940 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:11:48.197486 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.197487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.197501 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.197553 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:48.198507 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.199010 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.199962 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.200168 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.200223 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.202395 (+ 2172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:48.202396 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:48.202397 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:48.202404 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:48.203670 (+ 1266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.204037 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.204038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.204039 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.204103 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.204337 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.204338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.204339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.204454 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:48.204510 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.204764 (+ 254us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.204850 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260808 05:11:48.205103 6703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.196641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:34387 (local address 127.12.251.2:49133)
0808 05:11:48.196814 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.196857 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.197376 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.197622 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.197625 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.198177 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:48.198382 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.198388 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.199095 (+ 707us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.199096 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.199872 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.199874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.200236 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.200237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.200376 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.200854 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:48.200864 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:48.202311 (+ 1447us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:48.203745 (+ 1434us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:48.203752 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:48.203754 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:48.203971 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:48.204166 (+ 195us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:48.204167 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:48.204168 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:48.204279 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:48.204510 (+ 231us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:48.204516 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:48.204647 (+ 131us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.204734 (+ 87us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.204883 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
I20260808 05:11:48.205611 6699 heartbeater.cc:347] Connected to a master server at 127.12.251.62:34387
I20260808 05:11:48.205703 6699 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:48.205868 6699 heartbeater.cc:511] Master 127.12.251.62:34387 requested a full tablet report, sending...
I20260808 05:11:48.206218 6217 ts_manager.cc:194] Registered new tserver with Master: 484cdab617c840d0a2f5a45021d9a319 (127.12.251.2:35661)
I20260808 05:11:48.206693 6217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:49133
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:11:48.225461 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:34387
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:33111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:48.306624 6708 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:48.306813 6708 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:48.306834 6708 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:48.307896 6708 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:48.307929 6708 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:48.307953 6708 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:48.309340 6708 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:33111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:34387
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6708
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:48.309509 6708 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:48.309692 6708 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:11:48.314531 6708 server_base.cc:1034] running on GCE node
W20260808 05:11:48.314586 6720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.314507 6717 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.314514 6716 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.314894 6708 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:48.315138 6708 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:48.316269 6708 hybrid_clock.cc:648] HybridClock initialized: now 1786165908316254 us; error 38 us; skew 500 ppm
Aug 08 05:11:48 dist-test-slave-bndk krb5kdc[6150](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:48.318614 6708 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:11:48.319038 6708 webserver.cc:460] Webserver started at http://127.12.251.3:34065/ using document root <none> and password file <none>
I20260808 05:11:48.319233 6708 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:48.319274 6708 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:48.319401 6708 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:48.320392 6708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "cf3cce74d65e41778178e0a3100a1ef2"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "98f80540f06171591fcfb1328c6453a0"
server_key_iv: "762ef9336fc5f3168395b177ff6dc042"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.320729 6708 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "cf3cce74d65e41778178e0a3100a1ef2"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "98f80540f06171591fcfb1328c6453a0"
server_key_iv: "762ef9336fc5f3168395b177ff6dc042"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.322007 6708 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:48.322650 6733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.322790 6708 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:48.322870 6708 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "cf3cce74d65e41778178e0a3100a1ef2"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "98f80540f06171591fcfb1328c6453a0"
server_key_iv: "762ef9336fc5f3168395b177ff6dc042"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.322935 6708 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:48.334436 6708 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:48.336005 6708 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:48.336126 6708 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:48.336318 6708 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:48.336583 6708 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:48.336615 6708 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.336643 6708 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:48.336668 6708 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.342476 6708 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:46573
I20260808 05:11:48.342514 6913 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:46573 every 8 connection(s)
I20260808 05:11:48.342789 6708 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
Aug 08 05:11:48 dist-test-slave-bndk krb5kdc[6150](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165908, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:48.350358 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 6708
I20260808 05:11:48.350487 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:11:48.350690 13292 external_mini_cluster.cc:1428] Setting key b2d22f6ada4b5b7335e59b18a64e798a
I20260808 05:11:48.351529 6299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.343430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:38271 (local address 127.12.251.62:34387)
0808 05:11:48.343486 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.343488 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.343651 (+ 163us) server_negotiation.cc:407] Connection header received
0808 05:11:48.344110 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.344112 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.344123 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.344168 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:48.345030 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.345600 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.346581 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.346760 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.346806 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.348694 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:48.348695 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:48.348695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:48.348702 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:48.350005 (+ 1303us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.350491 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.350492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.350493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.350554 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.350849 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.350850 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.350850 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.351006 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:48.351056 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.351354 (+ 298us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.351437 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:11:48.351734 6916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.343388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:34387 (local address 127.12.251.3:38271)
0808 05:11:48.343533 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.343566 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.344024 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.344225 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.344228 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.344773 (+ 545us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:48.344959 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.344965 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.345676 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.345677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.346511 (+ 834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.346514 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.346814 (+ 300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.346815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.346908 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.347282 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:48.347290 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:48.348611 (+ 1321us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:48.350070 (+ 1459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:48.350076 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:48.350078 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:48.350343 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:48.350619 (+ 276us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:48.350620 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:48.350620 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:48.350780 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:48.351054 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:48.351067 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:48.351202 (+ 135us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.351324 (+ 122us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.351529 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":80,"threads_started":1}
I20260808 05:11:48.352118 6914 heartbeater.cc:347] Connected to a master server at 127.12.251.62:34387
I20260808 05:11:48.352205 6914 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:48.352370 6914 heartbeater.cc:511] Master 127.12.251.62:34387 requested a full tablet report, sending...
I20260808 05:11:48.352692 6217 ts_manager.cc:194] Registered new tserver with Master: cf3cce74d65e41778178e0a3100a1ef2 (127.12.251.3:46573)
I20260808 05:11:48.353025 6217 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:38271
I20260808 05:11:48.362341 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:11:48.369472 6299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.363701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33366 (local address 127.12.251.62:34387)
0808 05:11:48.363753 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.363755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.363848 (+ 93us) server_negotiation.cc:407] Connection header received
0808 05:11:48.363904 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.363904 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.363915 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.363974 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:48.364534 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.365013 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.365750 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.365951 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.366004 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.367094 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:48.367095 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:48.367096 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:48.367102 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:48.368369 (+ 1267us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.368684 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.368685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.368686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.368741 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:48.368902 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:48.368903 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:48.368903 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:48.369059 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:48.369157 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.369303 (+ 146us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.369383 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:11:48.370988 6217 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33366:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:11:48.372665 6217 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:11:48.379011 6935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.375154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41884 (local address 127.12.251.2:35661)
0808 05:11:48.375325 (+ 171us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.375330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.375339 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:48.375378 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.375380 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.375395 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.375508 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:48.375763 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.376850 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.378159 (+ 1309us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.378641 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.378703 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.378765 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.378895 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.378933 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":82,"threads_started":1}
I20260808 05:11:48.379056 6930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.374742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33325 (local address 127.0.0.1:36380)
0808 05:11:48.375105 (+ 363us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.375112 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.375147 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.375380 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.375384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.375386 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:48.375458 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.375460 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.376984 (+ 1524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.376985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.377923 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.377926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.378802 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.378803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.378872 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.378878 (+ 6us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.378908 (+ 30us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.378958 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":354,"mutex_wait_us":6,"thread_start_us":51,"threads_started":1}
I20260808 05:11:48.379042 6927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.374743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:35661 (local address 127.0.0.1:41884)
0808 05:11:48.374987 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.374996 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.375039 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.375592 (+ 553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.375593 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.375595 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:48.375640 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.375642 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.376942 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.376943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.378078 (+ 1135us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.378080 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.378716 (+ 636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.378717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.378794 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.378808 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.378873 (+ 65us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.378926 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":32,"thread_start_us":60,"threads_started":1}
I20260808 05:11:48.379324 6929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.374739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:46573 (local address 127.0.0.1:48224)
0808 05:11:48.374900 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.374939 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.375012 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.375673 (+ 661us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.375674 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.375677 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:48.375726 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.375727 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.376698 (+ 971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.376700 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.378049 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.378052 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.378924 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.378925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.378977 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.378980 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.379009 (+ 29us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.379043 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"mutex_wait_us":24,"thread_start_us":54,"threads_started":1}
I20260808 05:11:48.379513 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.375006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36380 (local address 127.12.251.1:33325)
0808 05:11:48.375184 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.375190 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.375203 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:11:48.375246 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.375249 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.375264 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.375346 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:48.375577 (+ 231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.376850 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.377999 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.378699 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.379285 (+ 586us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.379362 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.379391 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.379435 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":69,"threads_started":1}
I20260808 05:11:48.379861 6932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.374911 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48224 (local address 127.12.251.3:46573)
0808 05:11:48.375492 (+ 581us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.375505 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.375514 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:48.375553 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.375555 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.375571 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.375803 (+ 232us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:48.375872 (+ 69us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.376611 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.378143 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.378837 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.379646 (+ 809us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.379708 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.379737 (+ 29us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.379783 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":122,"threads_started":1}
I20260808 05:11:48.379978 6602 tablet_service.cc:1467] Processing CreateTablet for tablet 7eae5d8f38b14fdf9c74835eb2579f37 (DEFAULT_TABLE table=test-table [id=2a2d80d8064c41daa436f6f5d576894f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:48.380076 6402 tablet_service.cc:1467] Processing CreateTablet for tablet 7eae5d8f38b14fdf9c74835eb2579f37 (DEFAULT_TABLE table=test-table [id=2a2d80d8064c41daa436f6f5d576894f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:48.380362 6402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eae5d8f38b14fdf9c74835eb2579f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:48.380362 6602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eae5d8f38b14fdf9c74835eb2579f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:48.383697 6936 tablet_bootstrap.cc:492] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097: Bootstrap starting.
I20260808 05:11:48.384179 6807 tablet_service.cc:1467] Processing CreateTablet for tablet 7eae5d8f38b14fdf9c74835eb2579f37 (DEFAULT_TABLE table=test-table [id=2a2d80d8064c41daa436f6f5d576894f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:48.384320 6936 tablet_bootstrap.cc:654] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:48.384467 6807 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7eae5d8f38b14fdf9c74835eb2579f37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:48.384780 6936 log.cc:824] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:48.385113 6937 tablet_bootstrap.cc:492] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Bootstrap starting.
I20260808 05:11:48.385589 6936 tablet_bootstrap.cc:492] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097: No bootstrap required, opened a new log
I20260808 05:11:48.385658 6936 ts_tablet_manager.cc:1397] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:48.385764 6937 tablet_bootstrap.cc:654] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:48.386340 6937 log.cc:824] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:48.387130 6937 tablet_bootstrap.cc:492] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: No bootstrap required, opened a new log
I20260808 05:11:48.387204 6937 ts_tablet_manager.cc:1397] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:48.387233 6944 tablet_bootstrap.cc:492] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Bootstrap starting.
I20260808 05:11:48.387593 6936 raft_consensus.cc:348] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.387774 6936 raft_consensus.cc:374] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:48.387809 6936 raft_consensus.cc:729] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea708b31d81b456e9e98ba37958dd097, State: Initialized, Role: FOLLOWER
I20260808 05:11:48.387852 6944 tablet_bootstrap.cc:654] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:48.387919 6936 consensus_queue.cc:260] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.388198 6936 ts_tablet_manager.cc:1428] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:11:48.388211 6497 heartbeater.cc:503] Master 127.12.251.62:34387 was elected leader, sending a full tablet report...
I20260808 05:11:48.388438 6944 log.cc:824] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:48.388952 6937 raft_consensus.cc:348] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.389128 6937 raft_consensus.cc:374] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:48.389173 6937 raft_consensus.cc:729] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 484cdab617c840d0a2f5a45021d9a319, State: Initialized, Role: FOLLOWER
I20260808 05:11:48.389308 6937 consensus_queue.cc:260] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.389487 6944 tablet_bootstrap.cc:492] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: No bootstrap required, opened a new log
I20260808 05:11:48.389559 6944 ts_tablet_manager.cc:1397] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:48.389581 6699 heartbeater.cc:503] Master 127.12.251.62:34387 was elected leader, sending a full tablet report...
I20260808 05:11:48.389577 6937 ts_tablet_manager.cc:1428] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:11:48.391077 6944 raft_consensus.cc:348] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.391201 6944 raft_consensus.cc:374] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:48.391222 6944 raft_consensus.cc:729] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf3cce74d65e41778178e0a3100a1ef2, State: Initialized, Role: FOLLOWER
I20260808 05:11:48.391340 6944 consensus_queue.cc:260] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.391583 6944 ts_tablet_manager.cc:1428] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:48.391608 6914 heartbeater.cc:503] Master 127.12.251.62:34387 was elected leader, sending a full tablet report...
I20260808 05:11:48.400461 6951 raft_consensus.cc:482] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:48.400573 6951 raft_consensus.cc:504] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.400888 6951 leader_election.cc:288] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 484cdab617c840d0a2f5a45021d9a319 (127.12.251.2:35661), ea708b31d81b456e9e98ba37958dd097 (127.12.251.1:33325)
I20260808 05:11:48.403687 6916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.401041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33325 (local address 127.12.251.3:35031)
0808 05:11:48.401093 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.401105 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.401144 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.401309 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.401310 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.401312 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:48.401382 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.401384 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.402160 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.402161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.402907 (+ 746us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.402910 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.403452 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.403452 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.403528 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.403533 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.403581 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.403617 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":2}
I20260808 05:11:48.403697 6933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.401105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:35031 (local address 127.12.251.1:33325)
0808 05:11:48.401148 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.401150 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.401182 (+ 32us) server_negotiation.cc:407] Connection header received
0808 05:11:48.401210 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.401211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.401247 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.401292 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:48.401446 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.402089 (+ 643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.402993 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.403385 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.403444 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.403452 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.403594 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.403628 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260808 05:11:48.403751 6935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.401126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:43209 (local address 127.12.251.2:35661)
0808 05:11:48.401171 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.401173 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.401337 (+ 164us) server_negotiation.cc:407] Connection header received
0808 05:11:48.401365 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.401366 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.401374 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.401417 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:48.401564 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.402174 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.403086 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.403449 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.403519 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.403527 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.403662 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.403695 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:11:48.403956 6952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.401066 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:35661 (local address 127.12.251.3:43209)
0808 05:11:48.401259 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.401269 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.401325 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.401435 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.401436 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.401437 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:48.401497 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.401498 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.402252 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.402253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.403008 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.403011 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.403537 (+ 526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.403538 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.403600 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.403604 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.403650 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.403684 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"mutex_wait_us":2,"thread_start_us":95,"threads_started":1}
I20260808 05:11:48.404083 6432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae5d8f38b14fdf9c74835eb2579f37" candidate_uuid: "cf3cce74d65e41778178e0a3100a1ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea708b31d81b456e9e98ba37958dd097" is_pre_election: true
I20260808 05:11:48.404222 6432 raft_consensus.cc:2454] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3cce74d65e41778178e0a3100a1ef2 in term 0.
I20260808 05:11:48.404289 6631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae5d8f38b14fdf9c74835eb2579f37" candidate_uuid: "cf3cce74d65e41778178e0a3100a1ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "484cdab617c840d0a2f5a45021d9a319" is_pre_election: true
I20260808 05:11:48.404428 6631 raft_consensus.cc:2454] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf3cce74d65e41778178e0a3100a1ef2 in term 0.
I20260808 05:11:48.404424 6738 leader_election.cc:302] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf3cce74d65e41778178e0a3100a1ef2, ea708b31d81b456e9e98ba37958dd097; no voters:
I20260808 05:11:48.404546 6951 raft_consensus.cc:2781] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:11:48.404587 6951 raft_consensus.cc:482] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:11:48.404600 6951 raft_consensus.cc:3037] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:48.405310 6951 raft_consensus.cc:504] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.405428 6951 leader_election.cc:288] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [CANDIDATE]: Term 1 election: Requested vote from peers 484cdab617c840d0a2f5a45021d9a319 (127.12.251.2:35661), ea708b31d81b456e9e98ba37958dd097 (127.12.251.1:33325)
I20260808 05:11:48.405611 6432 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae5d8f38b14fdf9c74835eb2579f37" candidate_uuid: "cf3cce74d65e41778178e0a3100a1ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea708b31d81b456e9e98ba37958dd097"
I20260808 05:11:48.405674 6432 raft_consensus.cc:3037] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:48.405665 6631 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7eae5d8f38b14fdf9c74835eb2579f37" candidate_uuid: "cf3cce74d65e41778178e0a3100a1ef2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "484cdab617c840d0a2f5a45021d9a319"
I20260808 05:11:48.405745 6631 raft_consensus.cc:3037] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:48.406342 6432 raft_consensus.cc:2454] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3cce74d65e41778178e0a3100a1ef2 in term 1.
I20260808 05:11:48.406504 6631 raft_consensus.cc:2454] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf3cce74d65e41778178e0a3100a1ef2 in term 1.
I20260808 05:11:48.406510 6738 leader_election.cc:302] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf3cce74d65e41778178e0a3100a1ef2, ea708b31d81b456e9e98ba37958dd097; no voters:
I20260808 05:11:48.406594 6951 raft_consensus.cc:2781] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:48.406744 6951 raft_consensus.cc:686] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 1 LEADER]: Becoming Leader. State: Replica: cf3cce74d65e41778178e0a3100a1ef2, State: Running, Role: LEADER
I20260808 05:11:48.406842 6951 consensus_queue.cc:237] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } }
I20260808 05:11:48.407614 6217 catalog_manager.cc:5495] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf3cce74d65e41778178e0a3100a1ef2 (127.12.251.3). New cstate: current_term: 1 leader_uuid: "cf3cce74d65e41778178e0a3100a1ef2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf3cce74d65e41778178e0a3100a1ef2" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 46573 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 } health_report { overall_health: UNKNOWN } } }
I20260808 05:11:48.412957 6932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.411033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48234 (local address 127.12.251.3:46573)
0808 05:11:48.411084 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.411086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.411095 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:48.411130 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.411131 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.411145 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.411200 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:48.411304 (+ 104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.411733 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.412401 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.412579 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.412630 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.412726 (+ 96us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:48.412810 (+ 84us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:11:48.412870 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.412881 (+ 11us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.412895 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:11:48.414471 6631 raft_consensus.cc:1261] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 1 FOLLOWER]: Refusing update from remote peer cf3cce74d65e41778178e0a3100a1ef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:48.414485 6432 raft_consensus.cc:1261] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097 [term 1 FOLLOWER]: Refusing update from remote peer cf3cce74d65e41778178e0a3100a1ef2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:48.414793 6953 consensus_queue.cc:1035] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "484cdab617c840d0a2f5a45021d9a319" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 35661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:48.414911 6951 consensus_queue.cc:1035] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea708b31d81b456e9e98ba37958dd097" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33325 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:48.417394 6961 mvcc.cc:205] Tried to move back new op lower bound from 7316135560863600640 to 7316135560835117056. Current Snapshot: MvccSnapshot[applied={T|T < 7316135560863600640}]
I20260808 05:11:48.419740 6216 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:48.419839 6216 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33366:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:48.420521 6216 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1cc3842d8a6d4a4bb5c7a8b3a8eb8d30: Sending DeleteTablet for 3 replicas of tablet 7eae5d8f38b14fdf9c74835eb2579f37
I20260808 05:11:48.420825 6602 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae5d8f38b14fdf9c74835eb2579f37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:48 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:41884
I20260808 05:11:48.420857 6807 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae5d8f38b14fdf9c74835eb2579f37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:48 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:48224
I20260808 05:11:48.421074 6972 tablet_replica.cc:330] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: stopping tablet replica
I20260808 05:11:48.421082 6402 tablet_service.cc:1514] Processing DeleteTablet for tablet 7eae5d8f38b14fdf9c74835eb2579f37 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:48 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36380
I20260808 05:11:48.421168 6972 raft_consensus.cc:2229] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:11:48.421298 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 6305
I20260808 05:11:48.421306 6972 raft_consensus.cc:2258] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:48.421344 6976 tablet_replica.cc:330] T 7eae5d8f38b14fdf9c74835eb2579f37 P ea708b31d81b456e9e98ba37958dd097: stopping tablet replica
I20260808 05:11:48.421753 6972 ts_tablet_manager.cc:1905] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:48.423337 6972 ts_tablet_manager.cc:1918] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:48.423408 6972 log.cc:1196] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/7eae5d8f38b14fdf9c74835eb2579f37
I20260808 05:11:48.423668 6972 ts_tablet_manager.cc:1939] T 7eae5d8f38b14fdf9c74835eb2579f37 P cf3cce74d65e41778178e0a3100a1ef2: Deleting consensus metadata
I20260808 05:11:48.424048 6194 catalog_manager.cc:4841] TS cf3cce74d65e41778178e0a3100a1ef2 (127.12.251.3:46573): tablet 7eae5d8f38b14fdf9c74835eb2579f37 (table test-table [id=2a2d80d8064c41daa436f6f5d576894f]) successfully deleted
I20260808 05:11:48.431849 6971 tablet_replica.cc:330] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: stopping tablet replica
I20260808 05:11:48.431989 6971 raft_consensus.cc:2229] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:48.432113 6971 raft_consensus.cc:2258] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:48.432591 6971 ts_tablet_manager.cc:1905] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:48.434228 6971 ts_tablet_manager.cc:1918] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:48.434307 6971 log.cc:1196] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/7eae5d8f38b14fdf9c74835eb2579f37
I20260808 05:11:48.434584 6971 ts_tablet_manager.cc:1939] T 7eae5d8f38b14fdf9c74835eb2579f37 P 484cdab617c840d0a2f5a45021d9a319: Deleting consensus metadata
I20260808 05:11:48.434999 6192 catalog_manager.cc:4841] TS 484cdab617c840d0a2f5a45021d9a319 (127.12.251.2:35661): tablet 7eae5d8f38b14fdf9c74835eb2579f37 (table test-table [id=2a2d80d8064c41daa436f6f5d576894f]) successfully deleted
W20260808 05:11:48.435825 6197 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:33325 (error 108)
I20260808 05:11:48.436297 6927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.436164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33325 (local address 127.0.0.1:36382)
0808 05:11:48.436224 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.436263 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:33325: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 05:11:48.436378 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 6507
W20260808 05:11:48.446177 6197 catalog_manager.cc:4584] TS ea708b31d81b456e9e98ba37958dd097 (127.12.251.1:33325): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7eae5d8f38b14fdf9c74835eb2579f37: Network error: Client connection negotiation failed: client connection to 127.12.251.1:33325: connect: Connection refused (error 111)
I20260808 05:11:48.451979 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 6708
I20260808 05:11:48.461464 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 6167
2026-08-08T05:11:48Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (1969 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-08T05:11:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:48Z Disabled control of system clock
I20260808 05:11:48.494912 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39299
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:45339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:39299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:48.575573 6982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:48.575781 6982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:48.575800 6982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:48.576874 6982 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:48.576905 6982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:48.576916 6982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:48.576927 6982 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:48.576937 6982 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:48.578269 6982 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:39299
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:39299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:48.578469 6982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:48.578708 6982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:48.583187 6998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.583307 6982 server_base.cc:1034] running on GCE node
W20260808 05:11:48.583195 6992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.583268 6991 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.583619 6982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:48.583878 6982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:48.585024 6982 hybrid_clock.cc:648] HybridClock initialized: now 1786165908585009 us; error 32 us; skew 500 ppm
I20260808 05:11:48.586163 6982 webserver.cc:460] Webserver started at http://127.12.251.62:45333/ using document root <none> and password file <none>
I20260808 05:11:48.586397 6982 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:48.586449 6982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:48.586586 6982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:48.587630 6982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "1abf417d85a148a6a3b943fca997cda2"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "eecda7e2b6f5379f5a31380c235388ab"
server_key_iv: "6768d7fca114a83b95f0f0771e925003"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.587965 6982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "1abf417d85a148a6a3b943fca997cda2"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "eecda7e2b6f5379f5a31380c235388ab"
server_key_iv: "6768d7fca114a83b95f0f0771e925003"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.589150 6982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:11:48.589839 7006 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.589982 6982 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:48.590106 6982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "1abf417d85a148a6a3b943fca997cda2"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "eecda7e2b6f5379f5a31380c235388ab"
server_key_iv: "6768d7fca114a83b95f0f0771e925003"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.590173 6982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:48.607679 6982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:48.607985 6982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:48.608119 6982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:48.611939 6982 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:39299
I20260808 05:11:48.611974 7093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:39299 every 8 connection(s)
I20260808 05:11:48.612285 6982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:48.613209 7094 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:48.615532 7094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2: Bootstrap starting.
I20260808 05:11:48.616106 7094 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:48.616372 7094 log.cc:824] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:48.617036 7094 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2: No bootstrap required, opened a new log
I20260808 05:11:48.618628 7094 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abf417d85a148a6a3b943fca997cda2" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39299 } }
I20260808 05:11:48.618765 7094 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:48.618788 7094 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1abf417d85a148a6a3b943fca997cda2, State: Initialized, Role: FOLLOWER
I20260808 05:11:48.618911 7094 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abf417d85a148a6a3b943fca997cda2" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39299 } }
I20260808 05:11:48.618986 7094 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:48.619010 7094 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:48.619060 7094 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:48.619192 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 6982
I20260808 05:11:48.619292 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:48.619496 13292 external_mini_cluster.cc:1428] Setting key c4e78dc89cdf1db5701b12260979a281
I20260808 05:11:48.619629 7094 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abf417d85a148a6a3b943fca997cda2" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39299 } }
I20260808 05:11:48.619740 7094 leader_election.cc:302] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1abf417d85a148a6a3b943fca997cda2; no voters:
I20260808 05:11:48.619906 7094 leader_election.cc:288] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:48.619961 7098 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:48.620110 7098 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [term 1 LEADER]: Becoming Leader. State: Replica: 1abf417d85a148a6a3b943fca997cda2, State: Running, Role: LEADER
I20260808 05:11:48.620168 7094 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:48.620188 7098 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abf417d85a148a6a3b943fca997cda2" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39299 } }
I20260808 05:11:48.620554 7098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1abf417d85a148a6a3b943fca997cda2. Latest consensus state: current_term: 1 leader_uuid: "1abf417d85a148a6a3b943fca997cda2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abf417d85a148a6a3b943fca997cda2" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39299 } } }
I20260808 05:11:48.620635 7098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:48.620769 7103 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1abf417d85a148a6a3b943fca997cda2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1abf417d85a148a6a3b943fca997cda2" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 39299 } } }
I20260808 05:11:48.620860 7116 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:48.620899 7103 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:48.621654 7116 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:48.623131 7116 catalog_manager.cc:1347] Generated new cluster ID: 11de4a09ae604449a92e49708a299573
I20260808 05:11:48.623190 7116 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:48.626696 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.619977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35226 (local address 127.12.251.62:39299)
0808 05:11:48.620327 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.620338 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.621461 (+ 1123us) server_negotiation.cc:407] Connection header received
0808 05:11:48.621689 (+ 228us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.621697 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.621771 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.621887 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:48.622243 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.623513 (+ 1270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.624607 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.625247 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.625373 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.625996 (+ 623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:48.626000 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:48.626000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:48.626206 (+ 206us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:48.626247 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:48.626263 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:48.626335 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.626397 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.626483 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":109,"threads_started":1}
I20260808 05:11:48.631556 7116 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:48.632040 7116 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:48.636603 7116 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2: Generated new TSK 0
I20260808 05:11:48.636759 7116 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:11:48.640137 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39299
--builtin_ntp_servers=127.12.251.20:45339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:48.722180 7132 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:48.722385 7132 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:48.722407 7132 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:48.723510 7132 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:48.723547 7132 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:48.723570 7132 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:48.724848 7132 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7132
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:48.725068 7132 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:48.725399 7132 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:48.731071 7139 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.731109 7140 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.731262 7132 server_base.cc:1034] running on GCE node
W20260808 05:11:48.731071 7145 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.731648 7132 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:48.731869 7132 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:48.733031 7132 hybrid_clock.cc:648] HybridClock initialized: now 1786165908733020 us; error 33 us; skew 500 ppm
I20260808 05:11:48.734448 7132 webserver.cc:460] Webserver started at http://127.12.251.1:34377/ using document root <none> and password file <none>
I20260808 05:11:48.734680 7132 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:48.734724 7132 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:48.734848 7132 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:48.735939 7132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "cf0589c7018d4fdc820d36918d367e3d"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "4ce39c208afecc7376035856d1e934e9"
server_key_iv: "268aa2f506fcafa7194683132462e5f1"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.736268 7132 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "cf0589c7018d4fdc820d36918d367e3d"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "4ce39c208afecc7376035856d1e934e9"
server_key_iv: "268aa2f506fcafa7194683132462e5f1"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.737512 7132 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:48.738207 7158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.738341 7132 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:48.738435 7132 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "cf0589c7018d4fdc820d36918d367e3d"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "4ce39c208afecc7376035856d1e934e9"
server_key_iv: "268aa2f506fcafa7194683132462e5f1"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.738504 7132 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:48.766434 7132 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:48.766745 7132 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:48.766872 7132 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:48.767093 7132 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:48.767421 7132 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:48.767457 7132 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.767479 7132 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:48.767503 7132 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.773077 7132 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:39951
I20260808 05:11:48.773123 7351 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:39951 every 8 connection(s)
I20260808 05:11:48.773466 7132 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:11:48.775745 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 7132
I20260808 05:11:48.775838 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:11:48.776036 13292 external_mini_cluster.cc:1428] Setting key 66c9b60aa0d4e6595c29727cfbc31ec3
I20260808 05:11:48.776934 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39299
--builtin_ntp_servers=127.12.251.20:45339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:11:48.778806 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.774147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:59757 (local address 127.12.251.62:39299)
0808 05:11:48.774199 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.774202 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.774438 (+ 236us) server_negotiation.cc:407] Connection header received
0808 05:11:48.774943 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.774943 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.774958 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.775021 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:48.775680 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.776224 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.777432 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.777695 (+ 263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.777763 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.778519 (+ 756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:48.778520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:48.778521 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:48.778526 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:48.778544 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:48.778551 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:48.778608 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.778694 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.778728 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:11:48.779016 7356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.774132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39299 (local address 127.12.251.1:59757)
0808 05:11:48.774318 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.774358 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.774856 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.775078 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.775082 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.775090 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:48.775604 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.775611 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.776327 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.776328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.777331 (+ 1003us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.777335 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.777762 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.777763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.777868 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.778386 (+ 518us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:48.778386 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:48.778416 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:48.778439 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:48.778609 (+ 170us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:48.778611 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:48.778614 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.778670 (+ 56us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.778777 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":71,"threads_started":1}
I20260808 05:11:48.779460 7353 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39299
I20260808 05:11:48.779569 7353 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:48.779767 7353 heartbeater.cc:511] Master 127.12.251.62:39299 requested a full tablet report, sending...
I20260808 05:11:48.780285 7037 ts_manager.cc:194] Registered new tserver with Master: cf0589c7018d4fdc820d36918d367e3d (127.12.251.1:39951)
I20260808 05:11:48.780867 7037 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.1:59757
W20260808 05:11:48.859512 7358 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:48.859699 7358 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:48.859717 7358 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:48.860821 7358 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:48.860857 7358 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:48.860883 7358 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:48.862241 7358 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:48.862484 7358 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:48.862771 7358 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:48.867586 7366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.867596 7363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:48.867596 7364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:48.867672 7358 server_base.cc:1034] running on GCE node
I20260808 05:11:48.867941 7358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:48.868134 7358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:48.869277 7358 hybrid_clock.cc:648] HybridClock initialized: now 1786165908869259 us; error 27 us; skew 500 ppm
I20260808 05:11:48.870487 7358 webserver.cc:460] Webserver started at http://127.12.251.2:44631/ using document root <none> and password file <none>
I20260808 05:11:48.870711 7358 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:48.870760 7358 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:48.870885 7358 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:48.871882 7358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "98213e83079245fbb24aabb6e731302e"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "c6d423204ed487399a2f58225b9206a5"
server_key_iv: "b3c3eb83adb99071ac4c9523072cc5ea"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.872193 7358 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "98213e83079245fbb24aabb6e731302e"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "c6d423204ed487399a2f58225b9206a5"
server_key_iv: "b3c3eb83adb99071ac4c9523072cc5ea"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.873376 7358 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:11:48.874042 7376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.874192 7358 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:48.874274 7358 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "98213e83079245fbb24aabb6e731302e"
format_stamp: "Formatted at 2026-08-08 05:11:48 on dist-test-slave-bndk"
server_key: "c6d423204ed487399a2f58225b9206a5"
server_key_iv: "b3c3eb83adb99071ac4c9523072cc5ea"
server_key_version: "encryptionkey@0"
I20260808 05:11:48.874338 7358 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:48.921401 7358 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:48.921732 7358 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:48.921887 7358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:48.922140 7358 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:48.922473 7358 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:48.922509 7358 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.922539 7358 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:48.922556 7358 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:48.927816 7358 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:42203
I20260808 05:11:48.927891 7558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:42203 every 8 connection(s)
I20260808 05:11:48.928171 7358 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:11:48.932911 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.928841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:44945 (local address 127.12.251.62:39299)
0808 05:11:48.928924 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:48.928926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:48.929132 (+ 206us) server_negotiation.cc:407] Connection header received
0808 05:11:48.929659 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:48.929660 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:48.929670 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:48.929723 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:48.930373 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.930843 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.931773 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.931954 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.932001 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.932725 (+ 724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:48.932725 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:48.932726 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:48.932729 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:48.932739 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:48.932742 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:48.932775 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:48.932836 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 05:11:48.932854 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260808 05:11:48.933135 7564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:48.928821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39299 (local address 127.12.251.2:44945)
0808 05:11:48.929006 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:48.929049 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:48.929571 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:48.929791 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:48.929794 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:48.929803 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:48.930307 (+ 504us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.930312 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.930903 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.930903 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.931704 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:48.931706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:48.932008 (+ 302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:48.932008 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:48.932108 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:48.932612 (+ 504us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:48.932613 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:48.932642 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:48.932665 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:48.932783 (+ 118us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:48.932785 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:48.932788 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:48.932833 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:11:48.932910 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260808 05:11:48.933529 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 7358
I20260808 05:11:48.933642 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:11:48.933629 7559 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39299
I20260808 05:11:48.933704 7559 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:48.933837 13292 external_mini_cluster.cc:1428] Setting key ecfe090a64fead13b005720871b82c8f
I20260808 05:11:48.933851 7559 heartbeater.cc:511] Master 127.12.251.62:39299 requested a full tablet report, sending...
I20260808 05:11:48.934193 7037 ts_manager.cc:194] Registered new tserver with Master: 98213e83079245fbb24aabb6e731302e (127.12.251.2:42203)
I20260808 05:11:48.934523 7037 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.2:44945
I20260808 05:11:48.935279 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39299
--builtin_ntp_servers=127.12.251.20:45339
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:49.016310 7565 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:49.016508 7565 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:49.016528 7565 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:49.017653 7565 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:49.017690 7565 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:49.017719 7565 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:49.019032 7565 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:45339
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:39299
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7565
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:49.019244 7565 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:49.019520 7565 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:49.024750 7572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:49.024761 7570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:49.024761 7574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:49.024982 7565 server_base.cc:1034] running on GCE node
I20260808 05:11:49.025197 7565 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:49.025439 7565 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:49.026577 7565 hybrid_clock.cc:648] HybridClock initialized: now 1786165909026564 us; error 29 us; skew 500 ppm
I20260808 05:11:49.027722 7565 webserver.cc:460] Webserver started at http://127.12.251.3:41299/ using document root <none> and password file <none>
I20260808 05:11:49.027930 7565 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:49.027976 7565 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:49.028108 7565 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:49.029117 7565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "e2ffdbc979114321a3a79ff53bd278a5"
format_stamp: "Formatted at 2026-08-08 05:11:49 on dist-test-slave-bndk"
server_key: "4702f9fc6ea1765e67c9a535f6b6b64b"
server_key_iv: "b27d34a0e8c256fe5019c1d2bf8ec545"
server_key_version: "encryptionkey@0"
I20260808 05:11:49.029485 7565 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "e2ffdbc979114321a3a79ff53bd278a5"
format_stamp: "Formatted at 2026-08-08 05:11:49 on dist-test-slave-bndk"
server_key: "4702f9fc6ea1765e67c9a535f6b6b64b"
server_key_iv: "b27d34a0e8c256fe5019c1d2bf8ec545"
server_key_version: "encryptionkey@0"
I20260808 05:11:49.030778 7565 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:49.031489 7580 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:49.031646 7565 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:49.031729 7565 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "e2ffdbc979114321a3a79ff53bd278a5"
format_stamp: "Formatted at 2026-08-08 05:11:49 on dist-test-slave-bndk"
server_key: "4702f9fc6ea1765e67c9a535f6b6b64b"
server_key_iv: "b27d34a0e8c256fe5019c1d2bf8ec545"
server_key_version: "encryptionkey@0"
I20260808 05:11:49.031795 7565 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:49.044091 7565 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:49.044356 7565 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:49.044481 7565 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:49.044675 7565 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:49.044983 7565 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:49.045017 7565 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:49.045045 7565 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:49.045063 7565 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:49.050556 7565 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:35271
I20260808 05:11:49.050593 7747 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:35271 every 8 connection(s)
I20260808 05:11:49.050892 7565 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:11:49.055787 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.051558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:48225 (local address 127.12.251.62:39299)
0808 05:11:49.051612 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.051614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.051839 (+ 225us) server_negotiation.cc:407] Connection header received
0808 05:11:49.052393 (+ 554us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.052395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.052407 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.052458 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:49.053122 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.053643 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.054584 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.054779 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.054836 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.055531 (+ 695us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:49.055532 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:49.055532 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:49.055538 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:49.055553 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:49.055557 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:49.055599 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.055675 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.055706 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:11:49.055982 7750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.051547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:39299 (local address 127.12.251.3:48225)
0808 05:11:49.051724 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:49.051756 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:49.052234 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:49.052544 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:49.052549 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:49.052558 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:49.053035 (+ 477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.053040 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.053729 (+ 689us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.053731 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.054501 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.054503 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.054851 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.054852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.054976 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.055398 (+ 422us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:49.055398 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:49.055426 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:49.055449 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:49.055606 (+ 157us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:49.055611 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:49.055614 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:49.055674 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:11:49.055775 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
I20260808 05:11:49.056396 7748 heartbeater.cc:347] Connected to a master server at 127.12.251.62:39299
I20260808 05:11:49.056485 7748 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:49.056658 7748 heartbeater.cc:511] Master 127.12.251.62:39299 requested a full tablet report, sending...
I20260808 05:11:49.057001 7034 ts_manager.cc:194] Registered new tserver with Master: e2ffdbc979114321a3a79ff53bd278a5 (127.12.251.3:35271)
I20260808 05:11:49.057397 7034 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.3:48225
I20260808 05:11:49.060537 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 7565
I20260808 05:11:49.060614 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:11:49.060756 13292 external_mini_cluster.cc:1428] Setting key 6d28d3d6448b5c744de38f1fdc9c9c61
I20260808 05:11:49.061483 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:11:49.065364 7106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.062711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35230 (local address 127.12.251.62:39299)
0808 05:11:49.062761 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.062763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.062848 (+ 85us) server_negotiation.cc:407] Connection header received
0808 05:11:49.062912 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.062913 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.062925 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.062968 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:49.063167 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.063622 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.064332 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.064520 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.064573 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.065134 (+ 561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:49.065136 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:49.065136 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:49.065140 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:49.065153 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:49.065157 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:49.065198 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.065272 (+ 74us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.065293 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260808 05:11:49.066602 7034 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35230:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:11:49.068011 7034 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:11:49.074282 7761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.069908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:35271 (local address 127.0.0.1:60320)
0808 05:11:49.070245 (+ 337us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:49.070253 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:49.070291 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:49.070583 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:49.070585 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:49.070587 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:49.070628 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.070629 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.071805 (+ 1176us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.071806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.073166 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.073169 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.073992 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.073993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.074067 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.074081 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:11:49.074154 (+ 73us) client_negotiation.cc:240] Negotiation successful
0808 05:11:49.074206 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":325,"mutex_wait_us":32,"thread_start_us":98,"threads_started":1}
I20260808 05:11:49.074292 7766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.070231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60320 (local address 127.12.251.3:35271)
0808 05:11:49.070390 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.070393 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.070402 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:49.070443 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.070445 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.070457 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.070526 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:49.070699 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.071731 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.073267 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.073914 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.073973 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.074033 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.074183 (+ 150us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.074218 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":74,"threads_started":1}
I20260808 05:11:49.074707 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.069891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:42203 (local address 127.0.0.1:35070)
0808 05:11:49.070239 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:49.070248 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:49.070291 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:49.071820 (+ 1529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:49.071821 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:49.071824 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:49.071863 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.071865 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.072746 (+ 881us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.072747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.073640 (+ 893us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.073643 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.074509 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.074510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.074554 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.074557 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:49.074603 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:11:49.074641 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":336,"mutex_wait_us":1,"thread_start_us":77,"threads_started":1}
I20260808 05:11:49.074740 7764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.070073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35070 (local address 127.12.251.2:42203)
0808 05:11:49.070411 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.070416 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.070425 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:49.070460 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.070462 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.070476 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.070547 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:49.071936 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.072661 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.073717 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.074309 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.074373 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.074475 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.074632 (+ 157us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.074668 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":299,"thread_start_us":81,"threads_started":1}
I20260808 05:11:49.075187 7762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.069890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39951 (local address 127.0.0.1:50784)
0808 05:11:49.070055 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:49.070091 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:49.070156 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:49.070393 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:49.070396 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:49.070398 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:49.070457 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.070458 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.071794 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.071795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.073167 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.073170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.074971 (+ 1801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.074972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.075032 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.075036 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:49.075082 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:11:49.075121 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":45,"thread_start_us":56,"threads_started":1}
I20260808 05:11:49.075194 7653 tablet_service.cc:1467] Processing CreateTablet for tablet c206908d02ca4a62954a5602c2317911 (DEFAULT_TABLE table=test-table [id=2ace9bc876da4fa8968ef1b5745ec110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:49.075412 7763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.070066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50784 (local address 127.12.251.1:39951)
0808 05:11:49.070226 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.070230 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.070241 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:11:49.070283 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.070286 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.070301 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.070382 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:49.070533 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.071712 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.074067 (+ 2355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.074756 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.074842 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.074933 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.075297 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.075337 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260808 05:11:49.075376 7451 tablet_service.cc:1467] Processing CreateTablet for tablet c206908d02ca4a62954a5602c2317911 (DEFAULT_TABLE table=test-table [id=2ace9bc876da4fa8968ef1b5745ec110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:49.075562 7653 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c206908d02ca4a62954a5602c2317911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:49.075691 7451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c206908d02ca4a62954a5602c2317911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:49.076079 7239 tablet_service.cc:1467] Processing CreateTablet for tablet c206908d02ca4a62954a5602c2317911 (DEFAULT_TABLE table=test-table [id=2ace9bc876da4fa8968ef1b5745ec110]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:49.076385 7239 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c206908d02ca4a62954a5602c2317911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:49.079434 7767 tablet_bootstrap.cc:492] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Bootstrap starting.
I20260808 05:11:49.079573 7768 tablet_bootstrap.cc:492] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Bootstrap starting.
I20260808 05:11:49.080075 7767 tablet_bootstrap.cc:654] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:49.080108 7768 tablet_bootstrap.cc:654] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:49.080343 7767 log.cc:824] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:49.080346 7768 log.cc:824] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:49.080650 7769 tablet_bootstrap.cc:492] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d: Bootstrap starting.
I20260808 05:11:49.080962 7767 tablet_bootstrap.cc:492] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: No bootstrap required, opened a new log
I20260808 05:11:49.081027 7767 ts_tablet_manager.cc:1397] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:49.081159 7769 tablet_bootstrap.cc:654] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:49.081420 7769 log.cc:824] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:49.081841 7768 tablet_bootstrap.cc:492] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: No bootstrap required, opened a new log
I20260808 05:11:49.081909 7768 ts_tablet_manager.cc:1397] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:49.082163 7769 tablet_bootstrap.cc:492] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d: No bootstrap required, opened a new log
I20260808 05:11:49.082227 7769 ts_tablet_manager.cc:1397] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:49.083117 7767 raft_consensus.cc:348] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.083243 7767 raft_consensus.cc:374] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:49.083274 7767 raft_consensus.cc:729] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98213e83079245fbb24aabb6e731302e, State: Initialized, Role: FOLLOWER
I20260808 05:11:49.083396 7767 consensus_queue.cc:260] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.083626 7767 ts_tablet_manager.cc:1428] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:49.083743 7559 heartbeater.cc:503] Master 127.12.251.62:39299 was elected leader, sending a full tablet report...
I20260808 05:11:49.084322 7768 raft_consensus.cc:348] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.084492 7768 raft_consensus.cc:374] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:49.084528 7768 raft_consensus.cc:729] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e2ffdbc979114321a3a79ff53bd278a5, State: Initialized, Role: FOLLOWER
I20260808 05:11:49.084568 7769 raft_consensus.cc:348] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.084651 7768 consensus_queue.cc:260] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.084708 7769 raft_consensus.cc:374] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:49.084751 7769 raft_consensus.cc:729] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0589c7018d4fdc820d36918d367e3d, State: Initialized, Role: FOLLOWER
I20260808 05:11:49.084887 7768 ts_tablet_manager.cc:1428] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:49.084861 7769 consensus_queue.cc:260] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.084923 7748 heartbeater.cc:503] Master 127.12.251.62:39299 was elected leader, sending a full tablet report...
I20260808 05:11:49.085094 7769 ts_tablet_manager.cc:1428] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:49.085161 7353 heartbeater.cc:503] Master 127.12.251.62:39299 was elected leader, sending a full tablet report...
W20260808 05:11:49.178702 7560 tablet.cc:2369] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:11:49.188434 7782 raft_consensus.cc:482] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:49.188544 7782 raft_consensus.cc:504] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.188862 7782 leader_election.cc:288] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 98213e83079245fbb24aabb6e731302e (127.12.251.2:42203), e2ffdbc979114321a3a79ff53bd278a5 (127.12.251.3:35271)
I20260808 05:11:49.191434 7356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.189024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:35271 (local address 127.12.251.1:57427)
0808 05:11:49.189084 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:49.189095 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:49.189137 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:49.189291 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:49.189292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:49.189293 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:49.189362 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.189364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.189950 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.189951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.190687 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.190689 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.191192 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.191193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.191258 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.191261 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:49.191315 (+ 54us) client_negotiation.cc:240] Negotiation successful
0808 05:11:49.191358 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260808 05:11:49.191433 7766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.189110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:57427 (local address 127.12.251.3:35271)
0808 05:11:49.189159 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.189161 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.189170 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:49.189199 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.189200 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.189209 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.189280 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:49.189418 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.189884 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.190764 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.191127 (+ 363us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.191187 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.191195 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.191333 (+ 138us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.191367 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:11:49.191593 7764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.189080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:58415 (local address 127.12.251.2:42203)
0808 05:11:49.189175 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.189177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.189281 (+ 104us) server_negotiation.cc:407] Connection header received
0808 05:11:49.189345 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.189346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.189359 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.189404 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:49.189563 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.190020 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.190913 (+ 893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.191270 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.191345 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.191353 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.191495 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.191535 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:11:49.191592 7784 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.189038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:42203 (local address 127.12.251.1:58415)
0808 05:11:49.189201 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:49.189210 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:49.189291 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:49.189411 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:49.189412 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:49.189414 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:49.189497 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.189499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.190090 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.190091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.190828 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:49.190830 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.191351 (+ 521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.191352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:49.191431 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.191434 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:49.191477 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:11:49.191514 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":96,"threads_started":1}
I20260808 05:11:49.191780 7686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c206908d02ca4a62954a5602c2317911" candidate_uuid: "cf0589c7018d4fdc820d36918d367e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2ffdbc979114321a3a79ff53bd278a5" is_pre_election: true
I20260808 05:11:49.191936 7686 raft_consensus.cc:2454] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf0589c7018d4fdc820d36918d367e3d in term 0.
I20260808 05:11:49.191951 7482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c206908d02ca4a62954a5602c2317911" candidate_uuid: "cf0589c7018d4fdc820d36918d367e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98213e83079245fbb24aabb6e731302e" is_pre_election: true
I20260808 05:11:49.192092 7482 raft_consensus.cc:2454] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf0589c7018d4fdc820d36918d367e3d in term 0.
I20260808 05:11:49.192165 7163 leader_election.cc:302] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf0589c7018d4fdc820d36918d367e3d, e2ffdbc979114321a3a79ff53bd278a5; no voters:
I20260808 05:11:49.192287 7782 raft_consensus.cc:2781] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:11:49.192361 7782 raft_consensus.cc:482] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:11:49.192394 7782 raft_consensus.cc:3037] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:49.193084 7782 raft_consensus.cc:504] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.193300 7782 leader_election.cc:288] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [CANDIDATE]: Term 1 election: Requested vote from peers 98213e83079245fbb24aabb6e731302e (127.12.251.2:42203), e2ffdbc979114321a3a79ff53bd278a5 (127.12.251.3:35271)
I20260808 05:11:49.193385 7482 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c206908d02ca4a62954a5602c2317911" candidate_uuid: "cf0589c7018d4fdc820d36918d367e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "98213e83079245fbb24aabb6e731302e"
I20260808 05:11:49.193454 7482 raft_consensus.cc:3037] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:49.193445 7686 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c206908d02ca4a62954a5602c2317911" candidate_uuid: "cf0589c7018d4fdc820d36918d367e3d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e2ffdbc979114321a3a79ff53bd278a5"
I20260808 05:11:49.193521 7686 raft_consensus.cc:3037] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:49.194161 7686 raft_consensus.cc:2454] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf0589c7018d4fdc820d36918d367e3d in term 1.
I20260808 05:11:49.194161 7482 raft_consensus.cc:2454] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf0589c7018d4fdc820d36918d367e3d in term 1.
I20260808 05:11:49.194334 7161 leader_election.cc:302] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 98213e83079245fbb24aabb6e731302e, cf0589c7018d4fdc820d36918d367e3d; no voters:
I20260808 05:11:49.194459 7782 raft_consensus.cc:2781] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:49.194593 7782 raft_consensus.cc:686] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 1 LEADER]: Becoming Leader. State: Replica: cf0589c7018d4fdc820d36918d367e3d, State: Running, Role: LEADER
I20260808 05:11:49.194674 7782 consensus_queue.cc:237] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } }
I20260808 05:11:49.195480 7037 catalog_manager.cc:5495] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d reported cstate change: term changed from 0 to 1, leader changed from <none> to cf0589c7018d4fdc820d36918d367e3d (127.12.251.1). New cstate: current_term: 1 leader_uuid: "cf0589c7018d4fdc820d36918d367e3d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0589c7018d4fdc820d36918d367e3d" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 39951 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 } health_report { overall_health: UNKNOWN } } }
I20260808 05:11:49.218114 7763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.215883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50786 (local address 127.12.251.1:39951)
0808 05:11:49.215932 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:49.215934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:49.215943 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:49.216020 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:49.216021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:49.216039 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:49.216098 (+ 59us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:49.216207 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.216664 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.217439 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:49.217619 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:49.217671 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:49.217811 (+ 140us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:49.217908 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:11:49.217980 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:49.218000 (+ 20us) server_negotiation.cc:299] Negotiation successful
0808 05:11:49.218022 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:11:49.219838 7686 raft_consensus.cc:1261] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 1 FOLLOWER]: Refusing update from remote peer cf0589c7018d4fdc820d36918d367e3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:49.219842 7482 raft_consensus.cc:1261] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 1 FOLLOWER]: Refusing update from remote peer cf0589c7018d4fdc820d36918d367e3d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:49.220127 7782 consensus_queue.cc:1035] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "e2ffdbc979114321a3a79ff53bd278a5" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 35271 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:49.220274 7785 consensus_queue.cc:1035] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [LEADER]: Connected to new peer: Peer: permanent_uuid: "98213e83079245fbb24aabb6e731302e" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 42203 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:49.223100 7793 mvcc.cc:205] Tried to move back new op lower bound from 7316135564161888256 to 7316135564061962240. Current Snapshot: MvccSnapshot[applied={T|T < 7316135564161888256}]
I20260808 05:11:49.223166 7796 mvcc.cc:205] Tried to move back new op lower bound from 7316135564161888256 to 7316135564061962240. Current Snapshot: MvccSnapshot[applied={T|T < 7316135564161888256}]
I20260808 05:11:49.224404 7037 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:35230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:49.224485 7037 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:35230:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:49.225126 7037 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1abf417d85a148a6a3b943fca997cda2: Sending DeleteTablet for 3 replicas of tablet c206908d02ca4a62954a5602c2317911
I20260808 05:11:49.225446 7239 tablet_service.cc:1514] Processing DeleteTablet for tablet c206908d02ca4a62954a5602c2317911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:49 UTC) from {username='slave'} at 127.0.0.1:50784
I20260808 05:11:49.225521 7653 tablet_service.cc:1514] Processing DeleteTablet for tablet c206908d02ca4a62954a5602c2317911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:49 UTC) from {username='slave'} at 127.0.0.1:60320
I20260808 05:11:49.225661 7451 tablet_service.cc:1514] Processing DeleteTablet for tablet c206908d02ca4a62954a5602c2317911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:49 UTC) from {username='slave'} at 127.0.0.1:35070
I20260808 05:11:49.225760 7808 tablet_replica.cc:330] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d: stopping tablet replica
I20260808 05:11:49.225854 7808 raft_consensus.cc:2229] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:11:49.225903 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 7132
I20260808 05:11:49.225945 7808 raft_consensus.cc:2258] T c206908d02ca4a62954a5602c2317911 P cf0589c7018d4fdc820d36918d367e3d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:49.225988 7810 tablet_replica.cc:330] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: stopping tablet replica
I20260808 05:11:49.226061 7810 raft_consensus.cc:2229] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:49.238783 7811 tablet_replica.cc:330] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: stopping tablet replica
I20260808 05:11:49.238909 7811 raft_consensus.cc:2229] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:49.239028 7811 raft_consensus.cc:2258] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:49.239179 7810 raft_consensus.cc:2258] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:49.239542 7811 ts_tablet_manager.cc:1905] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:49.239636 7810 ts_tablet_manager.cc:1905] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:49.241195 7810 ts_tablet_manager.cc:1918] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:49.241204 7811 ts_tablet_manager.cc:1918] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:49.241285 7810 log.cc:1196] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/c206908d02ca4a62954a5602c2317911
I20260808 05:11:49.241307 7811 log.cc:1196] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/c206908d02ca4a62954a5602c2317911
I20260808 05:11:49.241549 7810 ts_tablet_manager.cc:1939] T c206908d02ca4a62954a5602c2317911 P e2ffdbc979114321a3a79ff53bd278a5: Deleting consensus metadata
I20260808 05:11:49.241570 7811 ts_tablet_manager.cc:1939] T c206908d02ca4a62954a5602c2317911 P 98213e83079245fbb24aabb6e731302e: Deleting consensus metadata
I20260808 05:11:49.241964 7008 catalog_manager.cc:4841] TS 98213e83079245fbb24aabb6e731302e (127.12.251.2:42203): tablet c206908d02ca4a62954a5602c2317911 (table test-table [id=2ace9bc876da4fa8968ef1b5745ec110]) successfully deleted
I20260808 05:11:49.242093 7011 catalog_manager.cc:4841] TS e2ffdbc979114321a3a79ff53bd278a5 (127.12.251.3:35271): tablet c206908d02ca4a62954a5602c2317911 (table test-table [id=2ace9bc876da4fa8968ef1b5745ec110]) successfully deleted
W20260808 05:11:49.243461 7012 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:39951 (error 108)
I20260808 05:11:49.243649 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 7358
I20260808 05:11:49.243901 7760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:49.243785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:39951 (local address 127.0.0.1:50790)
0808 05:11:49.243832 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:49.243870 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:39951: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 05:11:49.243994 7012 catalog_manager.cc:4584] TS cf0589c7018d4fdc820d36918d367e3d (127.12.251.1:39951): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c206908d02ca4a62954a5602c2317911: Network error: Client connection negotiation failed: client connection to 127.12.251.1:39951: connect: Connection refused (error 111)
I20260808 05:11:49.251133 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 7565
I20260808 05:11:49.259863 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 6982
2026-08-08T05:11:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (794 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:11:49 dist-test-slave-bndk krb5kdc[7817](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:11:49 dist-test-slave-bndk krb5kdc[7817](info): set up 2 sockets
Aug 08 05:11:49 dist-test-slave-bndk krb5kdc[7817](info): commencing operation
krb5kdc: starting...
W20260808 05:11:50.409497 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.128s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:11:50 dist-test-slave-bndk krb5kdc[7817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:11:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:11:50.528453 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42111
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:42111
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:50.610725 7841 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:50.610916 7841 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:50.610937 7841 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:50.612002 7841 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:50.612036 7841 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:50.612048 7841 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:50.612059 7841 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:50.612071 7841 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:50.613546 7841 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:42111
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7841
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:50.613736 7841 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:50.613914 7841 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:50.618672 7847 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:50.618781 7851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:50.618673 7849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:50.618957 7841 server_base.cc:1034] running on GCE node
I20260808 05:11:50.619148 7841 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:50.619379 7841 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:50.620504 7841 hybrid_clock.cc:648] HybridClock initialized: now 1786165910620499 us; error 34 us; skew 500 ppm
Aug 08 05:11:50 dist-test-slave-bndk krb5kdc[7817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165910, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:50.623075 7841 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:11:50.623456 7841 webserver.cc:460] Webserver started at http://127.12.251.62:38185/ using document root <none> and password file <none>
I20260808 05:11:50.623656 7841 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:50.623696 7841 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:50.623785 7841 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:50.624835 7841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "3f7aa2617b4840e2a369e7554fc5839d"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "7c5a4f223546e495d0442e6ada6221a1"
server_key_iv: "bfc99774e7616ec06d40d3e5362d3317"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.625125 7841 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "3f7aa2617b4840e2a369e7554fc5839d"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "7c5a4f223546e495d0442e6ada6221a1"
server_key_iv: "bfc99774e7616ec06d40d3e5362d3317"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.626410 7841 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:11:50.627067 7862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:50.627214 7841 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:11:50.627285 7841 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "3f7aa2617b4840e2a369e7554fc5839d"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "7c5a4f223546e495d0442e6ada6221a1"
server_key_iv: "bfc99774e7616ec06d40d3e5362d3317"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.627357 7841 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:50.640262 7841 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:50.642102 7841 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:50.642222 7841 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:50.646067 7841 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:42111
I20260808 05:11:50.646118 7936 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:42111 every 8 connection(s)
I20260808 05:11:50.646430 7841 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:50.647325 7939 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:50.649653 7939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d: Bootstrap starting.
I20260808 05:11:50.650184 7939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:50.650429 7939 log.cc:824] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:50.651067 7939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d: No bootstrap required, opened a new log
I20260808 05:11:50.652611 7939 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f7aa2617b4840e2a369e7554fc5839d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42111 } }
I20260808 05:11:50.652748 7939 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:50.652777 7939 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f7aa2617b4840e2a369e7554fc5839d, State: Initialized, Role: FOLLOWER
I20260808 05:11:50.652900 7939 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f7aa2617b4840e2a369e7554fc5839d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42111 } }
I20260808 05:11:50.652976 7939 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:50.653004 7939 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:50.653038 7939 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:50.653570 7939 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f7aa2617b4840e2a369e7554fc5839d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42111 } }
I20260808 05:11:50.653596 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 7841
I20260808 05:11:50.653690 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:50.653671 7939 leader_election.cc:302] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f7aa2617b4840e2a369e7554fc5839d; no voters:
I20260808 05:11:50.653831 7939 leader_election.cc:288] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:50.653873 13292 external_mini_cluster.cc:1428] Setting key 567065081f6ccebffa6e0440f0480b8b
I20260808 05:11:50.653863 7944 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:50.653976 7944 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [term 1 LEADER]: Becoming Leader. State: Replica: 3f7aa2617b4840e2a369e7554fc5839d, State: Running, Role: LEADER
I20260808 05:11:50.654070 7944 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f7aa2617b4840e2a369e7554fc5839d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42111 } }
I20260808 05:11:50.654112 7939 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:50.654459 7944 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f7aa2617b4840e2a369e7554fc5839d. Latest consensus state: current_term: 1 leader_uuid: "3f7aa2617b4840e2a369e7554fc5839d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f7aa2617b4840e2a369e7554fc5839d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42111 } } }
I20260808 05:11:50.654533 7944 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:50.654716 7945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f7aa2617b4840e2a369e7554fc5839d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f7aa2617b4840e2a369e7554fc5839d" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42111 } } }
I20260808 05:11:50.654783 7953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:50.654871 7945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:50.655411 7953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:50.657630 7953 catalog_manager.cc:1347] Generated new cluster ID: 5f57244a893149d2a3a1bf5649fef657
I20260808 05:11:50.657686 7953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:11:50 dist-test-slave-bndk krb5kdc[7817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165910, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:50.663822 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:50.654534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45796 (local address 127.12.251.62:42111)
0808 05:11:50.654710 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:50.654720 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:50.654978 (+ 258us) server_negotiation.cc:407] Connection header received
0808 05:11:50.655102 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:50.655110 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:50.655167 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:50.655301 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:50.656174 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:50.657209 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:50.658084 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:50.658503 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:50.658608 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:50.660754 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:50.660758 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:50.660758 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:50.660771 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:50.662380 (+ 1609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:50.662699 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:50.662703 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:50.662703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:50.662806 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:50.662989 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:50.662990 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:50.662990 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:50.663219 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:50.663379 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:50.663458 (+ 79us) server_negotiation.cc:299] Negotiation successful
0808 05:11:50.663676 (+ 218us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129,"thread_start_us":70,"threads_started":1}
I20260808 05:11:50.680172 7953 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:50.680698 7953 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:50.683169 7953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d: Generated new TSK 0
I20260808 05:11:50.683331 7953 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:11:50.716084 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42111
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:50.810266 7980 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:50.810473 7980 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:50.810496 7980 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:50.811652 7980 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:50.811693 7980 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:50.811719 7980 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:50.813169 7980 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7980
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:50.813417 7980 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:50.813635 7980 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:50.818557 7988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:50.818552 7987 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:50.818552 7995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:50.818786 7980 server_base.cc:1034] running on GCE node
I20260808 05:11:50.819010 7980 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:50.819227 7980 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:50.820392 7980 hybrid_clock.cc:648] HybridClock initialized: now 1786165910820374 us; error 29 us; skew 500 ppm
Aug 08 05:11:50 dist-test-slave-bndk krb5kdc[7817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165910, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:50.823011 7980 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:11:50.823426 7980 webserver.cc:460] Webserver started at http://127.12.251.1:46649/ using document root <none> and password file <none>
I20260808 05:11:50.823619 7980 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:50.823657 7980 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:50.823786 7980 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:50.824759 7980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "273b698fef7742368b9661382e38ac7e"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "2dc07ef3af48e93de721ba34175c856d"
server_key_iv: "f5f8883da1fc8a25662587c5cc9c145c"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.825068 7980 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "273b698fef7742368b9661382e38ac7e"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "2dc07ef3af48e93de721ba34175c856d"
server_key_iv: "f5f8883da1fc8a25662587c5cc9c145c"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.826380 7980 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:50.827052 8008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:50.827194 7980 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:50.827263 7980 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "273b698fef7742368b9661382e38ac7e"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "2dc07ef3af48e93de721ba34175c856d"
server_key_iv: "f5f8883da1fc8a25662587c5cc9c145c"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.827332 7980 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:50.853902 7980 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:50.855881 7980 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:50.856004 7980 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:50.856232 7980 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:50.856540 7980 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:50.856575 7980 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:50.856603 7980 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:50.856627 7980 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:50.861995 7980 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:43183
I20260808 05:11:50.862066 8178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:43183 every 8 connection(s)
I20260808 05:11:50.862349 7980 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:11:50 dist-test-slave-bndk krb5kdc[7817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165910, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:50.870891 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:50.863080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:43623 (local address 127.12.251.62:42111)
0808 05:11:50.863132 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:50.863134 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:50.863304 (+ 170us) server_negotiation.cc:407] Connection header received
0808 05:11:50.863839 (+ 535us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:50.863840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:50.863858 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:50.863909 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:50.864858 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:50.865413 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:50.866361 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:50.866566 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:50.866620 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:50.868550 (+ 1930us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:50.868552 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:50.868552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:50.868559 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:50.869666 (+ 1107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:50.870027 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:50.870027 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:50.870028 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:50.870072 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:50.870300 (+ 228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:50.870301 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:50.870301 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:50.870459 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:50.870524 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:50.870747 (+ 223us) server_negotiation.cc:299] Negotiation successful
0808 05:11:50.870817 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260808 05:11:50.871042 8184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:50.863045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42111 (local address 127.12.251.1:43623)
0808 05:11:50.863187 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:50.863225 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:50.863738 (+ 513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:50.863984 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:50.863987 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:50.864561 (+ 574us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:50.864759 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:50.864764 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:50.865508 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:50.865509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:50.866277 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:50.866279 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:50.866634 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:50.866635 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:50.866752 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:50.867145 (+ 393us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:50.867153 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:50.868467 (+ 1314us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:50.869740 (+ 1273us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:50.869747 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:50.869749 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:50.869967 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:50.870117 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:50.870117 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:50.870117 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:50.870206 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:50.870522 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:50.870526 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:50.870644 (+ 118us) client_negotiation.cc:769] Sending connection context
0808 05:11:50.870727 (+ 83us) client_negotiation.cc:240] Negotiation successful
0808 05:11:50.870847 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260808 05:11:50.871649 8181 heartbeater.cc:347] Connected to a master server at 127.12.251.62:42111
I20260808 05:11:50.871768 8181 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:50.871958 8181 heartbeater.cc:511] Master 127.12.251.62:42111 requested a full tablet report, sending...
I20260808 05:11:50.872334 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 7980
I20260808 05:11:50.872437 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:11:50.872620 13292 external_mini_cluster.cc:1428] Setting key 07ea54d98562c317cd0b901e3d76af47
I20260808 05:11:50.873090 7887 ts_manager.cc:194] Registered new tserver with Master: 273b698fef7742368b9661382e38ac7e (127.12.251.1:43183)
I20260808 05:11:50.873754 7887 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:43623
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:11:50.895785 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42111
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:50.975687 8187 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:50.975893 8187 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:50.975914 8187 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:50.976997 8187 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:50.977034 8187 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:50.977058 8187 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:50.978463 8187 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8187
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:50.978658 8187 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:50.978843 8187 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:50.983564 8198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:50.983675 8187 server_base.cc:1034] running on GCE node
W20260808 05:11:50.983546 8200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:50.983542 8196 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:50.983943 8187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:50.984149 8187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:50.985265 8187 hybrid_clock.cc:648] HybridClock initialized: now 1786165910985252 us; error 28 us; skew 500 ppm
Aug 08 05:11:50 dist-test-slave-bndk krb5kdc[7817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165910, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:50.987614 8187 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:11:50.988004 8187 webserver.cc:460] Webserver started at http://127.12.251.2:46185/ using document root <none> and password file <none>
I20260808 05:11:50.988176 8187 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:50.988214 8187 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:50.988301 8187 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:50.989310 8187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "b75c50d1c9324c37b476209d4b7a2b58"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "8cf3673da95435cb2ce947eec7597462"
server_key_iv: "d869ea25911050cee60c5407d1d6534d"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.989693 8187 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "b75c50d1c9324c37b476209d4b7a2b58"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "8cf3673da95435cb2ce947eec7597462"
server_key_iv: "d869ea25911050cee60c5407d1d6534d"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.991016 8187 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:11:50.991647 8210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:50.991799 8187 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:50.991880 8187 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "b75c50d1c9324c37b476209d4b7a2b58"
format_stamp: "Formatted at 2026-08-08 05:11:50 on dist-test-slave-bndk"
server_key: "8cf3673da95435cb2ce947eec7597462"
server_key_iv: "d869ea25911050cee60c5407d1d6534d"
server_key_version: "encryptionkey@0"
I20260808 05:11:50.991932 8187 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:51.003805 8187 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:51.005604 8187 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:51.005713 8187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:51.005888 8187 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:51.006161 8187 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:51.006192 8187 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.006213 8187 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:51.006229 8187 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.011631 8187 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:46659
I20260808 05:11:51.011700 8391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:46659 every 8 connection(s)
I20260808 05:11:51.011981 8187 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:11:51 dist-test-slave-bndk krb5kdc[7817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165910, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:51.020187 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 8187
I20260808 05:11:51.020300 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:11:51.020377 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.012669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:56195 (local address 127.12.251.62:42111)
0808 05:11:51.012721 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.012723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.012915 (+ 192us) server_negotiation.cc:407] Connection header received
0808 05:11:51.013413 (+ 498us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.013414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.013424 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.013471 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:51.014355 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.014855 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.015790 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.016007 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.016061 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.018020 (+ 1959us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:51.018022 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:51.018022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:51.018029 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:51.019249 (+ 1220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:51.019583 (+ 334us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:51.019583 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:51.019584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:51.019628 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:51.019796 (+ 168us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:51.019797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:51.019797 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:51.019889 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:51.019931 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.020190 (+ 259us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.020283 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:11:51.020504 8394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.012646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42111 (local address 127.12.251.2:56195)
0808 05:11:51.012804 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.012840 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.013336 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.013527 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.013530 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.014086 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:51.014274 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.014278 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.014922 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.014922 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.015717 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.015720 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.016068 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.016068 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.016162 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.016564 (+ 402us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:51.016572 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:51.017934 (+ 1362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:51.019313 (+ 1379us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:51.019318 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:51.019320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:51.019528 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:51.019670 (+ 142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:51.019670 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:51.019671 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:51.019758 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:51.019933 (+ 175us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:51.019936 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:51.020058 (+ 122us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.020143 (+ 85us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.020293 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260808 05:11:51.020525 13292 external_mini_cluster.cc:1428] Setting key a6d94d17837e1fe106c36dc4ed735e48
I20260808 05:11:51.021082 8392 heartbeater.cc:347] Connected to a master server at 127.12.251.62:42111
I20260808 05:11:51.021170 8392 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:51.021363 8392 heartbeater.cc:511] Master 127.12.251.62:42111 requested a full tablet report, sending...
I20260808 05:11:51.021782 7887 ts_manager.cc:194] Registered new tserver with Master: b75c50d1c9324c37b476209d4b7a2b58 (127.12.251.2:46659)
I20260808 05:11:51.022164 7887 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:56195
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:11:51.047250 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42111
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:36375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:51.129144 8398 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:51.129369 8398 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:51.129390 8398 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:51.130592 8398 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:51.130633 8398 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:51.130658 8398 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:51.132170 8398 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:36375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42111
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8398
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:51.132390 8398 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:51.132609 8398 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:51.137624 8411 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:51.137612 8406 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:51.137612 8407 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:51.137806 8398 server_base.cc:1034] running on GCE node
I20260808 05:11:51.138033 8398 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:51.138270 8398 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:51.139407 8398 hybrid_clock.cc:648] HybridClock initialized: now 1786165911139395 us; error 29 us; skew 500 ppm
Aug 08 05:11:51 dist-test-slave-bndk krb5kdc[7817](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165911, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:51.141772 8398 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:11:51.142166 8398 webserver.cc:460] Webserver started at http://127.12.251.3:45277/ using document root <none> and password file <none>
I20260808 05:11:51.142369 8398 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:51.142416 8398 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:51.142542 8398 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:51.143563 8398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "fee3919a8db34f1097b1df6d3c221f36"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "c3c71f19755e46a6354393e2decaffbc"
server_key_iv: "250bf41ef8fc697e9349e6df87635f12"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.143884 8398 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "fee3919a8db34f1097b1df6d3c221f36"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "c3c71f19755e46a6354393e2decaffbc"
server_key_iv: "250bf41ef8fc697e9349e6df87635f12"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.145117 8398 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:11:51.145797 8424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.145968 8398 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.146049 8398 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "fee3919a8db34f1097b1df6d3c221f36"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "c3c71f19755e46a6354393e2decaffbc"
server_key_iv: "250bf41ef8fc697e9349e6df87635f12"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.146109 8398 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:51.173269 8398 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:51.175071 8398 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:51.175206 8398 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:51.175406 8398 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:51.175707 8398 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:51.175746 8398 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.175777 8398 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:51.175800 8398 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.181421 8398 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:34419
I20260808 05:11:51.181485 8600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:34419 every 8 connection(s)
I20260808 05:11:51.181809 8398 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:11:51.182636 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 8398
I20260808 05:11:51.182720 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:11:51.182897 13292 external_mini_cluster.cc:1428] Setting key e9ed35335f746c8c1f69b9c8f4e0d596
Aug 08 05:11:51 dist-test-slave-bndk krb5kdc[7817](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165911, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:51.190372 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.182506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:36285 (local address 127.12.251.62:42111)
0808 05:11:51.182558 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.182560 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.182745 (+ 185us) server_negotiation.cc:407] Connection header received
0808 05:11:51.183357 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.183359 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.183371 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.183417 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:51.184404 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.184890 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.185895 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.186100 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.186152 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.188073 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:51.188074 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:51.188074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:51.188081 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:51.189144 (+ 1063us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:51.189507 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:51.189507 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:51.189508 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:51.189554 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:51.189772 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:51.189774 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:51.189774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:51.189946 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:51.190008 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.190236 (+ 228us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.190302 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:11:51.190491 8607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.182463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42111 (local address 127.12.251.3:36285)
0808 05:11:51.182628 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.182666 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.183265 (+ 599us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.183507 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.183511 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.184135 (+ 624us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:51.184328 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.184333 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.184963 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.184964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.185819 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.185822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.186160 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.186161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.186257 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.186694 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:51.186702 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:51.187996 (+ 1294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:51.189205 (+ 1209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:51.189211 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:51.189212 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:51.189450 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:51.189600 (+ 150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:51.189601 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:51.189601 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:51.189692 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:51.190003 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:51.190010 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:51.190122 (+ 112us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.190206 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.190322 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
I20260808 05:11:51.190915 8604 heartbeater.cc:347] Connected to a master server at 127.12.251.62:42111
I20260808 05:11:51.191011 8604 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:51.191149 8604 heartbeater.cc:511] Master 127.12.251.62:42111 requested a full tablet report, sending...
I20260808 05:11:51.191491 7887 ts_manager.cc:194] Registered new tserver with Master: fee3919a8db34f1097b1df6d3c221f36 (127.12.251.3:34419)
I20260808 05:11:51.191848 7887 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:36285
I20260808 05:11:51.194520 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:11:51.201262 7950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.195737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45806 (local address 127.12.251.62:42111)
0808 05:11:51.195774 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.195776 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.195911 (+ 135us) server_negotiation.cc:407] Connection header received
0808 05:11:51.195970 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.195971 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.195980 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.196030 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:51.196546 (+ 516us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.196989 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.197755 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.197930 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.197982 (+ 52us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.199173 (+ 1191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:51.199174 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:51.199174 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:51.199181 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:51.200149 (+ 968us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:51.200497 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:51.200498 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:51.200499 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:51.200545 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:51.200734 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:51.200735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:51.200735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:51.200857 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:51.200949 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.201084 (+ 135us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.201143 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:11:51.202574 7887 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45806:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:11:51.204084 7887 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:11:51.210212 8623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.206292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43183 (local address 127.0.0.1:50782)
0808 05:11:51.206644 (+ 352us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.206655 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.206722 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.206896 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.206900 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.206902 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:51.207005 (+ 103us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.207008 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.207959 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.207960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.209116 (+ 1156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.209119 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.209913 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.209914 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.209997 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.210011 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.210077 (+ 66us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.210130 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"thread_start_us":88,"threads_started":1}
I20260808 05:11:51.210215 8629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.206445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50782 (local address 127.12.251.1:43183)
0808 05:11:51.206635 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.206642 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.206721 (+ 79us) server_negotiation.cc:407] Connection header received
0808 05:11:51.206790 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.206792 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.206807 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.206880 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:51.207087 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.207866 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.209211 (+ 1345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.209841 (+ 630us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.209901 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.209963 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.210102 (+ 139us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.210140 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":105,"threads_started":1}
I20260808 05:11:51.210507 8621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.206268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:46659 (local address 127.0.0.1:52344)
0808 05:11:51.206582 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.206622 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.206688 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.207256 (+ 568us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.207257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.207259 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:51.207291 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.207293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.208475 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.208476 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.209328 (+ 852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.209331 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.210285 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.210286 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.210355 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.210360 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.210402 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.210439 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":287,"thread_start_us":45,"threads_started":1}
I20260808 05:11:51.210729 8626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.206373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52344 (local address 127.12.251.2:46659)
0808 05:11:51.206933 (+ 560us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.206937 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.206946 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:51.206980 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.206982 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.206995 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.207177 (+ 182us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:51.207365 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.208392 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.209396 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.210122 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.210191 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.210247 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.210611 (+ 364us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.210654 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":107,"threads_started":1}
I20260808 05:11:51.210973 8627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.206453 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:34419 (local address 127.0.0.1:56206)
0808 05:11:51.206753 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.206762 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.206813 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.207029 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.207030 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.207033 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:51.207076 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.207078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.208361 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.208362 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.209426 (+ 1064us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.209429 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.210673 (+ 1244us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.210674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.210732 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.210736 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.210897 (+ 161us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.210930 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"thread_start_us":68,"threads_started":1}
I20260808 05:11:51.210919 8075 tablet_service.cc:1467] Processing CreateTablet for tablet df57f939dcd544b9b793e100cd68b378 (DEFAULT_TABLE table=test-table [id=39b56c0f7a814e2b95270cd14a8b5e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:51.211313 8075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df57f939dcd544b9b793e100cd68b378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:51.211360 8630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.206545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56206 (local address 127.12.251.3:34419)
0808 05:11:51.206710 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.206715 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.206810 (+ 95us) server_negotiation.cc:407] Connection header received
0808 05:11:51.206875 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.206878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.206893 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.206965 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:51.207148 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.208254 (+ 1106us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.209516 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.210176 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.210227 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.211212 (+ 985us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.211237 (+ 25us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.211275 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260808 05:11:51.211465 8284 tablet_service.cc:1467] Processing CreateTablet for tablet df57f939dcd544b9b793e100cd68b378 (DEFAULT_TABLE table=test-table [id=39b56c0f7a814e2b95270cd14a8b5e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:51.211836 8284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df57f939dcd544b9b793e100cd68b378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:51.211936 8496 tablet_service.cc:1467] Processing CreateTablet for tablet df57f939dcd544b9b793e100cd68b378 (DEFAULT_TABLE table=test-table [id=39b56c0f7a814e2b95270cd14a8b5e11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:51.212234 8496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df57f939dcd544b9b793e100cd68b378. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:51.214509 8631 tablet_bootstrap.cc:492] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: Bootstrap starting.
I20260808 05:11:51.215153 8635 tablet_bootstrap.cc:492] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Bootstrap starting.
I20260808 05:11:51.215272 8631 tablet_bootstrap.cc:654] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:51.215375 8638 tablet_bootstrap.cc:492] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Bootstrap starting.
I20260808 05:11:51.215924 8638 tablet_bootstrap.cc:654] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:51.215904 8631 log.cc:824] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:51.215978 8635 tablet_bootstrap.cc:654] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:51.216425 8638 log.cc:824] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:51.216475 8635 log.cc:824] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:51.216717 8631 tablet_bootstrap.cc:492] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: No bootstrap required, opened a new log
I20260808 05:11:51.216781 8631 ts_tablet_manager.cc:1397] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:51.217137 8638 tablet_bootstrap.cc:492] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: No bootstrap required, opened a new log
I20260808 05:11:51.217195 8638 ts_tablet_manager.cc:1397] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:51.217190 8635 tablet_bootstrap.cc:492] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: No bootstrap required, opened a new log
I20260808 05:11:51.217280 8635 ts_tablet_manager.cc:1397] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:51.218564 8638 raft_consensus.cc:348] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.218703 8638 raft_consensus.cc:374] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:51.218736 8638 raft_consensus.cc:729] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fee3919a8db34f1097b1df6d3c221f36, State: Initialized, Role: FOLLOWER
I20260808 05:11:51.218848 8638 consensus_queue.cc:260] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.219100 8638 ts_tablet_manager.cc:1428] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:51.219089 8631 raft_consensus.cc:348] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.219240 8604 heartbeater.cc:503] Master 127.12.251.62:42111 was elected leader, sending a full tablet report...
I20260808 05:11:51.219264 8631 raft_consensus.cc:374] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:51.219300 8631 raft_consensus.cc:729] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 273b698fef7742368b9661382e38ac7e, State: Initialized, Role: FOLLOWER
I20260808 05:11:51.219404 8631 consensus_queue.cc:260] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.219167 8635 raft_consensus.cc:348] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.219660 8635 raft_consensus.cc:374] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:51.219702 8631 ts_tablet_manager.cc:1428] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:51.219709 8635 raft_consensus.cc:729] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b75c50d1c9324c37b476209d4b7a2b58, State: Initialized, Role: FOLLOWER
I20260808 05:11:51.219811 8635 consensus_queue.cc:260] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.219872 8181 heartbeater.cc:503] Master 127.12.251.62:42111 was elected leader, sending a full tablet report...
I20260808 05:11:51.220077 8635 ts_tablet_manager.cc:1428] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260808 05:11:51.220077 8392 heartbeater.cc:503] Master 127.12.251.62:42111 was elected leader, sending a full tablet report...
W20260808 05:11:51.262503 8393 tablet.cc:2369] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:11:51.363067 8182 tablet.cc:2369] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:11:51.432359 8605 tablet.cc:2369] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:11:51.498813 8649 raft_consensus.cc:482] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:51.498945 8649 raft_consensus.cc:504] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.499264 8649 leader_election.cc:288] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fee3919a8db34f1097b1df6d3c221f36 (127.12.251.3:34419), 273b698fef7742368b9661382e38ac7e (127.12.251.1:43183)
I20260808 05:11:51.501937 8394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.499439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:34419 (local address 127.12.251.2:40159)
0808 05:11:51.499487 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.499498 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.499543 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.499714 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.499715 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.499718 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:51.499786 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.499788 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.500385 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.500386 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.501108 (+ 722us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.501110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.501678 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.501679 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.501761 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.501764 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.501810 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.501851 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:11:51.501925 8630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.499526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:40159 (local address 127.12.251.3:34419)
0808 05:11:51.499583 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.499585 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.499593 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:11:51.499625 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.499626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.499638 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.499704 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:51.499852 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.500318 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.501196 (+ 878us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.501611 (+ 415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.501675 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.501684 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.501825 (+ 141us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.501857 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:11:51.502071 8629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.499573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:34395 (local address 127.12.251.1:43183)
0808 05:11:51.499630 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.499633 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.499765 (+ 132us) server_negotiation.cc:407] Connection header received
0808 05:11:51.499810 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.499811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.499822 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.499864 (+ 42us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:51.500022 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.500488 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.501409 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.501764 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.501825 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.501832 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.501974 (+ 142us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.502008 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:11:51.502079 8650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.499439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43183 (local address 127.12.251.2:34395)
0808 05:11:51.499699 (+ 260us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.499707 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.499758 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.499865 (+ 107us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.499866 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.499868 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:51.499958 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.499959 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.500564 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.500565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.501332 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.501335 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.501838 (+ 503us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.501839 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.501904 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.501908 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.501958 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.501995 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":150,"thread_start_us":61,"threads_started":1}
I20260808 05:11:51.502306 8531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df57f939dcd544b9b793e100cd68b378" candidate_uuid: "b75c50d1c9324c37b476209d4b7a2b58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fee3919a8db34f1097b1df6d3c221f36" is_pre_election: true
I20260808 05:11:51.502436 8105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df57f939dcd544b9b793e100cd68b378" candidate_uuid: "b75c50d1c9324c37b476209d4b7a2b58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273b698fef7742368b9661382e38ac7e" is_pre_election: true
I20260808 05:11:51.502481 8531 raft_consensus.cc:2454] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b75c50d1c9324c37b476209d4b7a2b58 in term 0.
I20260808 05:11:51.502562 8105 raft_consensus.cc:2454] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b75c50d1c9324c37b476209d4b7a2b58 in term 0.
I20260808 05:11:51.502729 8214 leader_election.cc:302] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b75c50d1c9324c37b476209d4b7a2b58, fee3919a8db34f1097b1df6d3c221f36; no voters:
I20260808 05:11:51.502873 8649 raft_consensus.cc:2781] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:11:51.502933 8649 raft_consensus.cc:482] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:11:51.502959 8649 raft_consensus.cc:3037] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:51.503655 8649 raft_consensus.cc:504] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.503777 8649 leader_election.cc:288] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [CANDIDATE]: Term 1 election: Requested vote from peers fee3919a8db34f1097b1df6d3c221f36 (127.12.251.3:34419), 273b698fef7742368b9661382e38ac7e (127.12.251.1:43183)
I20260808 05:11:51.503925 8105 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df57f939dcd544b9b793e100cd68b378" candidate_uuid: "b75c50d1c9324c37b476209d4b7a2b58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "273b698fef7742368b9661382e38ac7e"
I20260808 05:11:51.503944 8531 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df57f939dcd544b9b793e100cd68b378" candidate_uuid: "b75c50d1c9324c37b476209d4b7a2b58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fee3919a8db34f1097b1df6d3c221f36"
I20260808 05:11:51.504009 8105 raft_consensus.cc:3037] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:51.504009 8531 raft_consensus.cc:3037] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:51.504864 8105 raft_consensus.cc:2454] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b75c50d1c9324c37b476209d4b7a2b58 in term 1.
I20260808 05:11:51.504864 8531 raft_consensus.cc:2454] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b75c50d1c9324c37b476209d4b7a2b58 in term 1.
I20260808 05:11:51.505043 8211 leader_election.cc:302] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 273b698fef7742368b9661382e38ac7e, b75c50d1c9324c37b476209d4b7a2b58; no voters:
I20260808 05:11:51.505152 8649 raft_consensus.cc:2781] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:51.505335 8649 raft_consensus.cc:686] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 1 LEADER]: Becoming Leader. State: Replica: b75c50d1c9324c37b476209d4b7a2b58, State: Running, Role: LEADER
I20260808 05:11:51.505437 8649 consensus_queue.cc:237] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } }
I20260808 05:11:51.506232 7886 catalog_manager.cc:5495] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 reported cstate change: term changed from 0 to 1, leader changed from <none> to b75c50d1c9324c37b476209d4b7a2b58 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "b75c50d1c9324c37b476209d4b7a2b58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b75c50d1c9324c37b476209d4b7a2b58" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 46659 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 } health_report { overall_health: UNKNOWN } } }
I20260808 05:11:51.561352 8626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.559233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52350 (local address 127.12.251.2:46659)
0808 05:11:51.559287 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.559289 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.559310 (+ 21us) server_negotiation.cc:407] Connection header received
0808 05:11:51.559347 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.559347 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.559368 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.559421 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:51.559544 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.560008 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.560698 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.560888 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.560937 (+ 49us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.561056 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:51.561146 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:11:51.561233 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.561266 (+ 33us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.561275 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:11:51.563104 8531 raft_consensus.cc:1261] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 1 FOLLOWER]: Refusing update from remote peer b75c50d1c9324c37b476209d4b7a2b58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:51.563104 8105 raft_consensus.cc:1261] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 1 FOLLOWER]: Refusing update from remote peer b75c50d1c9324c37b476209d4b7a2b58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:51.563449 8649 consensus_queue.cc:1035] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "273b698fef7742368b9661382e38ac7e" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 43183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:51.563585 8651 consensus_queue.cc:1035] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fee3919a8db34f1097b1df6d3c221f36" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 34419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:51.568075 7887 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:51.568161 7887 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45806:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:51.568831 7887 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3f7aa2617b4840e2a369e7554fc5839d: Sending DeleteTablet for 3 replicas of tablet df57f939dcd544b9b793e100cd68b378
I20260808 05:11:51.569124 8075 tablet_service.cc:1514] Processing DeleteTablet for tablet df57f939dcd544b9b793e100cd68b378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:51 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:50782
I20260808 05:11:51.569154 8284 tablet_service.cc:1514] Processing DeleteTablet for tablet df57f939dcd544b9b793e100cd68b378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:51 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:52344
I20260808 05:11:51.569361 8673 tablet_replica.cc:330] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e: stopping tablet replica
I20260808 05:11:51.569322 8496 tablet_service.cc:1514] Processing DeleteTablet for tablet df57f939dcd544b9b793e100cd68b378 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:51 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:56206
I20260808 05:11:51.569433 8673 raft_consensus.cc:2229] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:51.569525 8673 raft_consensus.cc:2258] T df57f939dcd544b9b793e100cd68b378 P 273b698fef7742368b9661382e38ac7e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:51.569551 8677 tablet_replica.cc:330] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: stopping tablet replica
I20260808 05:11:51.569656 8676 tablet_replica.cc:330] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: stopping tablet replica
I20260808 05:11:51.569662 8677 raft_consensus.cc:2229] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:51.569751 8677 raft_consensus.cc:2258] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:51.569823 8676 raft_consensus.cc:2229] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:11:51.569949 8676 raft_consensus.cc:2258] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:51.569968 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 7980
I20260808 05:11:51.570384 8676 ts_tablet_manager.cc:1905] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:51.572247 8676 ts_tablet_manager.cc:1918] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:51.572320 8676 log.cc:1196] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/df57f939dcd544b9b793e100cd68b378
I20260808 05:11:51.572614 8676 ts_tablet_manager.cc:1939] T df57f939dcd544b9b793e100cd68b378 P b75c50d1c9324c37b476209d4b7a2b58: Deleting consensus metadata
I20260808 05:11:51.572839 8677 ts_tablet_manager.cc:1905] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:51.572974 7869 catalog_manager.cc:4841] TS b75c50d1c9324c37b476209d4b7a2b58 (127.12.251.2:46659): tablet df57f939dcd544b9b793e100cd68b378 (table test-table [id=39b56c0f7a814e2b95270cd14a8b5e11]) successfully deleted
I20260808 05:11:51.574745 8677 ts_tablet_manager.cc:1918] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:51.574805 8677 log.cc:1196] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/df57f939dcd544b9b793e100cd68b378
I20260808 05:11:51.575063 8677 ts_tablet_manager.cc:1939] T df57f939dcd544b9b793e100cd68b378 P fee3919a8db34f1097b1df6d3c221f36: Deleting consensus metadata
I20260808 05:11:51.589756 7869 catalog_manager.cc:4841] TS fee3919a8db34f1097b1df6d3c221f36 (127.12.251.3:34419): tablet df57f939dcd544b9b793e100cd68b378 (table test-table [id=39b56c0f7a814e2b95270cd14a8b5e11]) successfully deleted
W20260808 05:11:51.599246 7863 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:43183 (error 108)
I20260808 05:11:51.599471 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 8187
I20260808 05:11:51.600039 8627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.599651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:43183 (local address 127.0.0.1:50798)
0808 05:11:51.599952 (+ 301us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.599998 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:43183: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":278}
W20260808 05:11:51.601282 7863 catalog_manager.cc:4584] TS 273b698fef7742368b9661382e38ac7e (127.12.251.1:43183): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet df57f939dcd544b9b793e100cd68b378: Network error: Client connection negotiation failed: client connection to 127.12.251.1:43183: connect: Connection refused (error 111)
I20260808 05:11:51.614328 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 8398
I20260808 05:11:51.624686 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 7841
2026-08-08T05:11:51Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2364 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-08T05:11:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:51Z Disabled control of system clock
I20260808 05:11:51.653663 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:40943
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:32793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:40943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:51.735677 8682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:51.735893 8682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:51.735911 8682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:51.737042 8682 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:51.737084 8682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:51.737095 8682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:51.737106 8682 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:51.737118 8682 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:51.738498 8682 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:32793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:40943
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:40943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:51.738741 8682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:51.739030 8682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:51.743763 8694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:51.743752 8688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:51.743768 8690 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:51.744102 8682 server_base.cc:1034] running on GCE node
I20260808 05:11:51.744315 8682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:51.744571 8682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:51.745702 8682 hybrid_clock.cc:648] HybridClock initialized: now 1786165911745690 us; error 27 us; skew 500 ppm
I20260808 05:11:51.749877 8682 webserver.cc:460] Webserver started at http://127.12.251.62:42599/ using document root <none> and password file <none>
I20260808 05:11:51.750077 8682 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:51.750119 8682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:51.750216 8682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:51.751245 8682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "71433e2197a84e74876ab60b54440bdb"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "97b9c840f6884624eb89d533983e4a79"
server_key_iv: "f604c1ce18da3c09f6f20f91ab52e4c3"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.751564 8682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "71433e2197a84e74876ab60b54440bdb"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "97b9c840f6884624eb89d533983e4a79"
server_key_iv: "f604c1ce18da3c09f6f20f91ab52e4c3"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.752707 8682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:11:51.753362 8701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.753520 8682 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.753604 8682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "71433e2197a84e74876ab60b54440bdb"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "97b9c840f6884624eb89d533983e4a79"
server_key_iv: "f604c1ce18da3c09f6f20f91ab52e4c3"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.753660 8682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:51.763088 8682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:51.763317 8682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:51.763411 8682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:51.767040 8682 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:40943
I20260808 05:11:51.767072 8782 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:40943 every 8 connection(s)
I20260808 05:11:51.767365 8682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:51.767755 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 8682
I20260808 05:11:51.767877 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:51.768092 13292 external_mini_cluster.cc:1428] Setting key bd93e26adca26c0ec1a3ff19b2146053
I20260808 05:11:51.768584 8783 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:51.771730 8783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb: Bootstrap starting.
I20260808 05:11:51.772281 8783 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:51.772560 8783 log.cc:824] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:51.773341 8783 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb: No bootstrap required, opened a new log
I20260808 05:11:51.773640 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.768599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37742 (local address 127.12.251.62:40943)
0808 05:11:51.768819 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.768828 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.768859 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:11:51.769369 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.769378 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.769462 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.769608 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:51.769797 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.771098 (+ 1301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.771849 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.772252 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.772364 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.773009 (+ 645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:51.773014 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:51.773014 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:51.773167 (+ 153us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:51.773199 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:51.773209 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:51.773289 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.773366 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.773446 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":74,"threads_started":1}
I20260808 05:11:51.775276 8783 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71433e2197a84e74876ab60b54440bdb" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40943 } }
I20260808 05:11:51.775409 8783 raft_consensus.cc:374] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:51.775441 8783 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71433e2197a84e74876ab60b54440bdb, State: Initialized, Role: FOLLOWER
I20260808 05:11:51.775563 8783 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71433e2197a84e74876ab60b54440bdb" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40943 } }
I20260808 05:11:51.775621 8783 raft_consensus.cc:388] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:51.775652 8783 raft_consensus.cc:482] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:51.775696 8783 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:51.776196 8783 raft_consensus.cc:504] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71433e2197a84e74876ab60b54440bdb" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40943 } }
I20260808 05:11:51.776289 8783 leader_election.cc:302] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 71433e2197a84e74876ab60b54440bdb; no voters:
I20260808 05:11:51.776455 8783 leader_election.cc:288] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:51.776501 8791 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:51.776665 8791 raft_consensus.cc:686] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [term 1 LEADER]: Becoming Leader. State: Replica: 71433e2197a84e74876ab60b54440bdb, State: Running, Role: LEADER
I20260808 05:11:51.776717 8783 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:51.776768 8791 consensus_queue.cc:237] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71433e2197a84e74876ab60b54440bdb" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40943 } }
I20260808 05:11:51.777107 8792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "71433e2197a84e74876ab60b54440bdb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71433e2197a84e74876ab60b54440bdb" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40943 } } }
I20260808 05:11:51.777123 8794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 71433e2197a84e74876ab60b54440bdb. Latest consensus state: current_term: 1 leader_uuid: "71433e2197a84e74876ab60b54440bdb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "71433e2197a84e74876ab60b54440bdb" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 40943 } } }
I20260808 05:11:51.777272 8792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:51.777282 8794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:51.777587 8805 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:51.778066 8805 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:51.779470 8805 catalog_manager.cc:1347] Generated new cluster ID: c6326724b7f0433a9e5aa493046d9d55
I20260808 05:11:51.779521 8805 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:51.796278 8805 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:51.796739 8805 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:51.801523 8805 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb: Generated new TSK 0
I20260808 05:11:51.801692 8805 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:11:51.804826 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40943
--builtin_ntp_servers=127.12.251.20:32793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:51.911541 8826 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:51.911759 8826 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:51.911791 8826 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:51.912933 8826 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:51.912976 8826 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:51.913009 8826 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:51.914378 8826 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:32793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8826
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:51.914625 8826 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:51.914915 8826 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:51.919729 8835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:51.919749 8837 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:51.919773 8839 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:51.920051 8826 server_base.cc:1034] running on GCE node
I20260808 05:11:51.920248 8826 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:51.920473 8826 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:51.921638 8826 hybrid_clock.cc:648] HybridClock initialized: now 1786165911921620 us; error 35 us; skew 500 ppm
I20260808 05:11:51.922899 8826 webserver.cc:460] Webserver started at http://127.12.251.1:42075/ using document root <none> and password file <none>
I20260808 05:11:51.923151 8826 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:51.923195 8826 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:51.923331 8826 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:51.924377 8826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "176d13a638ad463db56263cc1229a519"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "c1795f430f2cc72ffd69628be44d4b1d"
server_key_iv: "a8e5f8c77a3d547c5d6779dae55fc861"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.924706 8826 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "176d13a638ad463db56263cc1229a519"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "c1795f430f2cc72ffd69628be44d4b1d"
server_key_iv: "a8e5f8c77a3d547c5d6779dae55fc861"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.926033 8826 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:51.926714 8846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.926873 8826 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:51.926961 8826 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "176d13a638ad463db56263cc1229a519"
format_stamp: "Formatted at 2026-08-08 05:11:51 on dist-test-slave-bndk"
server_key: "c1795f430f2cc72ffd69628be44d4b1d"
server_key_iv: "a8e5f8c77a3d547c5d6779dae55fc861"
server_key_version: "encryptionkey@0"
I20260808 05:11:51.927019 8826 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:51.945459 8826 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:51.945722 8826 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:51.945822 8826 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:51.946004 8826 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:51.946271 8826 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:51.946301 8826 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.946328 8826 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:51.946344 8826 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:51.951779 8826 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:34217
I20260808 05:11:51.951862 9024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:34217 every 8 connection(s)
I20260808 05:11:51.952140 8826 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:11:51.957231 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.952806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:33439 (local address 127.12.251.62:40943)
0808 05:11:51.952863 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:51.952865 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:51.953110 (+ 245us) server_negotiation.cc:407] Connection header received
0808 05:11:51.953804 (+ 694us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:51.953805 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:51.953818 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:51.953859 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:51.954561 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.955050 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.956034 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.956237 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.956286 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.956988 (+ 702us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:51.956989 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:51.956990 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:51.956994 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:51.957009 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:51.957013 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:51.957053 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:51.957117 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 05:11:51.957148 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:11:51.957408 9032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:51.952795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:40943 (local address 127.12.251.1:33439)
0808 05:11:51.952991 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:51.953025 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:51.953695 (+ 670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:51.953935 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:51.953938 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:51.953948 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:51.954493 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.954498 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.955137 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.955138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.955975 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:51.955977 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:51.956293 (+ 316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:51.956294 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:51.956396 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:51.956836 (+ 440us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:51.956836 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:51.956864 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:51.956885 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:51.957059 (+ 174us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:51.957062 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:51.957065 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:51.957113 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:11:51.957188 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":83,"threads_started":1}
I20260808 05:11:51.957895 9026 heartbeater.cc:347] Connected to a master server at 127.12.251.62:40943
I20260808 05:11:51.957983 9026 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:51.958140 9026 heartbeater.cc:511] Master 127.12.251.62:40943 requested a full tablet report, sending...
I20260808 05:11:51.958606 8729 ts_manager.cc:194] Registered new tserver with Master: 176d13a638ad463db56263cc1229a519 (127.12.251.1:34217)
I20260808 05:11:51.959193 8729 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.1:33439
I20260808 05:11:51.961160 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 8826
I20260808 05:11:51.961278 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:11:51.961447 13292 external_mini_cluster.cc:1428] Setting key eb5375692506ed05d74348a1ce676137
I20260808 05:11:51.962224 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40943
--builtin_ntp_servers=127.12.251.20:32793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:52.044139 9038 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:52.044338 9038 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:52.044359 9038 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:52.045491 9038 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:52.045523 9038 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:52.045547 9038 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:52.046890 9038 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:32793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9038
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:52.047078 9038 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:52.047333 9038 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:52.051981 9050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:52.052124 9038 server_base.cc:1034] running on GCE node
W20260808 05:11:52.051960 9048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:52.051970 9047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:52.052443 9038 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:52.052644 9038 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:52.053784 9038 hybrid_clock.cc:648] HybridClock initialized: now 1786165912053772 us; error 27 us; skew 500 ppm
I20260808 05:11:52.054972 9038 webserver.cc:460] Webserver started at http://127.12.251.2:41625/ using document root <none> and password file <none>
I20260808 05:11:52.055195 9038 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:52.055239 9038 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:52.055369 9038 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:52.056566 9038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "0cf45bc1f6ca4930a78a657981083522"
format_stamp: "Formatted at 2026-08-08 05:11:52 on dist-test-slave-bndk"
server_key: "1578d3126bf8c3e94424d85a7f576d55"
server_key_iv: "db69558536658a5a67e95f5f6f42fc8f"
server_key_version: "encryptionkey@0"
I20260808 05:11:52.056877 9038 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "0cf45bc1f6ca4930a78a657981083522"
format_stamp: "Formatted at 2026-08-08 05:11:52 on dist-test-slave-bndk"
server_key: "1578d3126bf8c3e94424d85a7f576d55"
server_key_iv: "db69558536658a5a67e95f5f6f42fc8f"
server_key_version: "encryptionkey@0"
I20260808 05:11:52.058141 9038 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:52.058845 9058 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:52.059015 9038 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:52.059099 9038 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "0cf45bc1f6ca4930a78a657981083522"
format_stamp: "Formatted at 2026-08-08 05:11:52 on dist-test-slave-bndk"
server_key: "1578d3126bf8c3e94424d85a7f576d55"
server_key_iv: "db69558536658a5a67e95f5f6f42fc8f"
server_key_version: "encryptionkey@0"
I20260808 05:11:52.059152 9038 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:52.068200 9038 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:52.068434 9038 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:52.068532 9038 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:52.068691 9038 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:52.068936 9038 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:52.068965 9038 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:52.068990 9038 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:52.069006 9038 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:52.074326 9038 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:34055
I20260808 05:11:52.074390 9240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:34055 every 8 connection(s)
I20260808 05:11:52.074656 9038 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:11:52.077208 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 9038
I20260808 05:11:52.077332 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:11:52.077548 13292 external_mini_cluster.cc:1428] Setting key 3f52f93841d2e9c36e0ef270557d477f
I20260808 05:11:52.078537 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40943
--builtin_ntp_servers=127.12.251.20:32793
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260808 05:11:52.080137 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.075308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:52223 (local address 127.12.251.62:40943)
0808 05:11:52.075367 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.075369 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.075583 (+ 214us) server_negotiation.cc:407] Connection header received
0808 05:11:52.076061 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.076062 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.076074 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.076126 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:52.076810 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.077522 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.078824 (+ 1302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.079066 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.079138 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.079870 (+ 732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:52.079871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:52.079872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:52.079876 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:52.079892 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:52.079897 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:52.079953 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.080031 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.080057 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:11:52.080333 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.075291 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:40943 (local address 127.12.251.2:52223)
0808 05:11:52.075465 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.075506 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:52.075968 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:52.076191 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:52.076195 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:52.076203 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:52.076705 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.076710 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.077620 (+ 910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.077622 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.078750 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.078753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.079136 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.079137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.079240 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.079738 (+ 498us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:52.079738 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:52.079767 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:52.079790 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:52.079953 (+ 163us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:52.079956 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:52.079959 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:52.080012 (+ 53us) client_negotiation.cc:240] Negotiation successful
0808 05:11:52.080111 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":76,"threads_started":1}
I20260808 05:11:52.080734 9241 heartbeater.cc:347] Connected to a master server at 127.12.251.62:40943
I20260808 05:11:52.080833 9241 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:52.081015 9241 heartbeater.cc:511] Master 127.12.251.62:40943 requested a full tablet report, sending...
I20260808 05:11:52.081360 8729 ts_manager.cc:194] Registered new tserver with Master: 0cf45bc1f6ca4930a78a657981083522 (127.12.251.2:34055)
I20260808 05:11:52.081735 8729 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.2:52223
W20260808 05:11:52.160539 9245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:52.160737 9245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:52.160756 9245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:52.161999 9245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:52.162036 9245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:52.162060 9245 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:52.163439 9245 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:32793
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:40943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:52.163661 9245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:52.163941 9245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:52.168634 9254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:52.168637 9256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:52.168651 9253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:52.168865 9245 server_base.cc:1034] running on GCE node
I20260808 05:11:52.169243 9245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:52.169463 9245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:52.170603 9245 hybrid_clock.cc:648] HybridClock initialized: now 1786165912170594 us; error 28 us; skew 500 ppm
I20260808 05:11:52.171747 9245 webserver.cc:460] Webserver started at http://127.12.251.3:45717/ using document root <none> and password file <none>
I20260808 05:11:52.171970 9245 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:52.172029 9245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:52.172154 9245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:52.173152 9245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "a008567e45224644a3ae014ce7823908"
format_stamp: "Formatted at 2026-08-08 05:11:52 on dist-test-slave-bndk"
server_key: "ecb52689092ea2d0f99091120f1abf75"
server_key_iv: "52b43b973e3c34f2ae0c389f3222aebc"
server_key_version: "encryptionkey@0"
I20260808 05:11:52.173516 9245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "a008567e45224644a3ae014ce7823908"
format_stamp: "Formatted at 2026-08-08 05:11:52 on dist-test-slave-bndk"
server_key: "ecb52689092ea2d0f99091120f1abf75"
server_key_iv: "52b43b973e3c34f2ae0c389f3222aebc"
server_key_version: "encryptionkey@0"
I20260808 05:11:52.174708 9245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:52.175396 9266 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:52.175551 9245 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:52.175637 9245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "a008567e45224644a3ae014ce7823908"
format_stamp: "Formatted at 2026-08-08 05:11:52 on dist-test-slave-bndk"
server_key: "ecb52689092ea2d0f99091120f1abf75"
server_key_iv: "52b43b973e3c34f2ae0c389f3222aebc"
server_key_version: "encryptionkey@0"
I20260808 05:11:52.175689 9245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:52.186319 9245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:52.186618 9245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:52.186753 9245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:52.186970 9245 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:52.187263 9245 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:52.187295 9245 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:52.187318 9245 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:52.187335 9245 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:52.192613 9245 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:37687
I20260808 05:11:52.192680 9441 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:37687 every 8 connection(s)
I20260808 05:11:52.192909 9245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:11:52.194092 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 9245
I20260808 05:11:52.194190 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:11:52.194387 13292 external_mini_cluster.cc:1428] Setting key c69f0ca3230488fad3babb382530955f
I20260808 05:11:52.197757 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.193569 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:60767 (local address 127.12.251.62:40943)
0808 05:11:52.193625 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.193628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.193892 (+ 264us) server_negotiation.cc:407] Connection header received
0808 05:11:52.194386 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.194388 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.194400 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.194467 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:52.195222 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.195728 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.196652 (+ 924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.196823 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.196865 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.197568 (+ 703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:52.197569 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:52.197570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:52.197574 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:52.197589 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:52.197593 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:52.197633 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.197678 (+ 45us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.197700 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:11:52.197948 9445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.193548 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:40943 (local address 127.12.251.3:60767)
0808 05:11:52.193780 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.193811 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:52.194292 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:52.194537 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:52.194541 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:52.194552 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:52.195142 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.195148 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.195798 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.195799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.196592 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.196594 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.196873 (+ 279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.196874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.196973 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.197448 (+ 475us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:52.197449 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:52.197475 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:52.197496 (+ 21us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:52.197633 (+ 137us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:52.197635 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:52.197637 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:11:52.197679 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:11:52.197749 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":113,"threads_started":1}
I20260808 05:11:52.198421 9443 heartbeater.cc:347] Connected to a master server at 127.12.251.62:40943
I20260808 05:11:52.198508 9443 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:52.198675 9443 heartbeater.cc:511] Master 127.12.251.62:40943 requested a full tablet report, sending...
I20260808 05:11:52.199021 8729 ts_manager.cc:194] Registered new tserver with Master: a008567e45224644a3ae014ce7823908 (127.12.251.3:37687)
I20260808 05:11:52.199386 8729 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.3:60767
I20260808 05:11:52.205896 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:11:52.209959 8789 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.207185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37756 (local address 127.12.251.62:40943)
0808 05:11:52.207233 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.207235 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.207323 (+ 88us) server_negotiation.cc:407] Connection header received
0808 05:11:52.207385 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.207385 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.207395 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.207436 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:52.207603 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.208069 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.208766 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.208970 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.209023 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.209678 (+ 655us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:52.209680 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:52.209680 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:52.209684 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:52.209699 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:52.209703 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:52.209784 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.209859 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.209869 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:11:52.211361 8729 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37756:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:11:52.212874 8729 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:11:52.218753 9456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.214899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:34217 (local address 127.0.0.1:57282)
0808 05:11:52.215264 (+ 365us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.215272 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:52.215354 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:52.215649 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:52.215650 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:52.215652 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:52.215693 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.215695 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.216582 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.216583 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.217714 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.217717 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.218462 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.218463 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.218554 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.218569 (+ 15us) client_negotiation.cc:769] Sending connection context
0808 05:11:52.218632 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 05:11:52.218681 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":349,"thread_start_us":100,"threads_started":1}
I20260808 05:11:52.218765 9459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.215012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57282 (local address 127.12.251.1:34217)
0808 05:11:52.215208 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.215212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.215325 (+ 113us) server_negotiation.cc:407] Connection header received
0808 05:11:52.215456 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.215459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.215475 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.215547 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:52.215773 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.216499 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.217793 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.218389 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.218450 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.218544 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.218645 (+ 101us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.218682 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":84,"threads_started":1}
I20260808 05:11:52.219187 9455 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.214880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:34055 (local address 127.0.0.1:55974)
0808 05:11:52.215190 (+ 310us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.215228 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:52.215296 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:52.215589 (+ 293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:52.215592 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:52.215594 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:52.215659 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.215661 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.216982 (+ 1321us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.216983 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.218011 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.218014 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.218974 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.218975 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.219037 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.219040 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:52.219082 (+ 42us) client_negotiation.cc:240] Negotiation successful
0808 05:11:52.219119 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":284,"mutex_wait_us":29,"thread_start_us":71,"threads_started":1}
I20260808 05:11:52.219347 9460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.215109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:37687 (local address 127.0.0.1:54820)
0808 05:11:52.215404 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.215413 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:52.215455 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:52.215701 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:52.215702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:52.215704 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:52.215736 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.215737 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.217008 (+ 1271us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.217009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.217955 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.217958 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.219144 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.219145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.219203 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.219208 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:11:52.219249 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 05:11:52.219284 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":282,"thread_start_us":62,"threads_started":1}
I20260808 05:11:52.219494 9457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.214986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55974 (local address 127.12.251.2:34055)
0808 05:11:52.215412 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.215417 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.215429 (+ 12us) server_negotiation.cc:407] Connection header received
0808 05:11:52.215469 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.215471 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.215486 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.215735 (+ 249us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:52.215794 (+ 59us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.216897 (+ 1103us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.218099 (+ 1202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.218793 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.218850 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.218940 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.219356 (+ 416us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.219399 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":103,"threads_started":1}
I20260808 05:11:52.219481 8918 tablet_service.cc:1467] Processing CreateTablet for tablet 0262805e4a744d16a8f61516152b312b (DEFAULT_TABLE table=test-table [id=b9101fabd5524a84803ac9e7654e90a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:52.219642 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.215203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54820 (local address 127.12.251.3:37687)
0808 05:11:52.215388 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.215392 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.215520 (+ 128us) server_negotiation.cc:407] Connection header received
0808 05:11:52.215564 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.215566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.215579 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.215642 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:52.215801 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.216896 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.218039 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.218767 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.219142 (+ 375us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.219374 (+ 232us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.219522 (+ 148us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.219564 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":89,"threads_started":1}
I20260808 05:11:52.219895 8918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0262805e4a744d16a8f61516152b312b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:52.220052 9132 tablet_service.cc:1467] Processing CreateTablet for tablet 0262805e4a744d16a8f61516152b312b (DEFAULT_TABLE table=test-table [id=b9101fabd5524a84803ac9e7654e90a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:52.220310 9132 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0262805e4a744d16a8f61516152b312b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:52.220227 9346 tablet_service.cc:1467] Processing CreateTablet for tablet 0262805e4a744d16a8f61516152b312b (DEFAULT_TABLE table=test-table [id=b9101fabd5524a84803ac9e7654e90a6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:52.220556 9346 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0262805e4a744d16a8f61516152b312b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:52.222681 9464 tablet_bootstrap.cc:492] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Bootstrap starting.
I20260808 05:11:52.223225 9466 tablet_bootstrap.cc:492] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519: Bootstrap starting.
I20260808 05:11:52.223296 9464 tablet_bootstrap.cc:654] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:52.223608 9464 log.cc:824] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:52.223773 9468 tablet_bootstrap.cc:492] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Bootstrap starting.
I20260808 05:11:52.223865 9466 tablet_bootstrap.cc:654] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:52.224133 9466 log.cc:824] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:52.224390 9468 tablet_bootstrap.cc:654] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:52.224416 9464 tablet_bootstrap.cc:492] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: No bootstrap required, opened a new log
I20260808 05:11:52.224473 9464 ts_tablet_manager.cc:1397] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:52.224691 9468 log.cc:824] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:52.224931 9466 tablet_bootstrap.cc:492] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519: No bootstrap required, opened a new log
I20260808 05:11:52.225003 9466 ts_tablet_manager.cc:1397] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:52.225291 9468 tablet_bootstrap.cc:492] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: No bootstrap required, opened a new log
I20260808 05:11:52.225351 9468 ts_tablet_manager.cc:1397] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:52.227039 9464 raft_consensus.cc:348] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.227212 9464 raft_consensus.cc:374] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:52.227248 9464 raft_consensus.cc:729] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cf45bc1f6ca4930a78a657981083522, State: Initialized, Role: FOLLOWER
I20260808 05:11:52.227190 9468 raft_consensus.cc:348] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.227331 9468 raft_consensus.cc:374] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:52.227371 9468 raft_consensus.cc:729] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a008567e45224644a3ae014ce7823908, State: Initialized, Role: FOLLOWER
I20260808 05:11:52.227399 9464 consensus_queue.cc:260] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.227391 9466 raft_consensus.cc:348] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.227484 9468 consensus_queue.cc:260] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.227541 9466 raft_consensus.cc:374] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:52.227584 9466 raft_consensus.cc:729] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 176d13a638ad463db56263cc1229a519, State: Initialized, Role: FOLLOWER
I20260808 05:11:52.227656 9464 ts_tablet_manager.cc:1428] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:52.227741 9468 ts_tablet_manager.cc:1428] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:52.227712 9466 consensus_queue.cc:260] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.227773 9241 heartbeater.cc:503] Master 127.12.251.62:40943 was elected leader, sending a full tablet report...
I20260808 05:11:52.227788 9443 heartbeater.cc:503] Master 127.12.251.62:40943 was elected leader, sending a full tablet report...
I20260808 05:11:52.227943 9466 ts_tablet_manager.cc:1428] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:52.227982 9026 heartbeater.cc:503] Master 127.12.251.62:40943 was elected leader, sending a full tablet report...
I20260808 05:11:52.296819 9476 raft_consensus.cc:482] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:52.296947 9476 raft_consensus.cc:504] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.297356 9476 leader_election.cc:288] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 176d13a638ad463db56263cc1229a519 (127.12.251.1:34217), a008567e45224644a3ae014ce7823908 (127.12.251.3:37687)
I20260808 05:11:52.299948 9459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.297610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:48333 (local address 127.12.251.1:34217)
0808 05:11:52.297677 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.297679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.297690 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:11:52.297721 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.297722 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.297734 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.297792 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:52.297939 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.298395 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.299303 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.299658 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.299721 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.299729 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.299846 (+ 117us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.299882 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260808 05:11:52.299948 9243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.297524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:34217 (local address 127.12.251.2:48333)
0808 05:11:52.297584 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.297595 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:52.297650 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:52.297808 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:52.297809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:52.297811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:52.297872 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.297874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.298459 (+ 585us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.298460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.299217 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.299219 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.299726 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.299727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.299786 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.299789 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:52.299834 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:11:52.299873 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 05:11:52.300096 9462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.297729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:39747 (local address 127.12.251.3:37687)
0808 05:11:52.297773 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.297775 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.297840 (+ 65us) server_negotiation.cc:407] Connection header received
0808 05:11:52.297889 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.297890 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.297898 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.297946 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:52.298076 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.298532 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.299418 (+ 886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.299774 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.299834 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.299841 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.299984 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.300021 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:11:52.300251 9480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.297627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:37687 (local address 127.12.251.2:39747)
0808 05:11:52.297781 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.297790 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:52.297835 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:52.297953 (+ 118us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:52.297953 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:52.297955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:52.298019 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.298021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.298607 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.298608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.299331 (+ 723us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:52.299333 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.299848 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.299849 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:52.299916 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.299919 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:52.299969 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:11:52.300127 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260808 05:11:52.300282 8954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0262805e4a744d16a8f61516152b312b" candidate_uuid: "0cf45bc1f6ca4930a78a657981083522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176d13a638ad463db56263cc1229a519" is_pre_election: true
I20260808 05:11:52.300457 8954 raft_consensus.cc:2454] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cf45bc1f6ca4930a78a657981083522 in term 0.
I20260808 05:11:52.300561 9374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0262805e4a744d16a8f61516152b312b" candidate_uuid: "0cf45bc1f6ca4930a78a657981083522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a008567e45224644a3ae014ce7823908" is_pre_election: true
I20260808 05:11:52.300678 9063 leader_election.cc:302] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cf45bc1f6ca4930a78a657981083522, 176d13a638ad463db56263cc1229a519; no voters:
I20260808 05:11:52.300709 9374 raft_consensus.cc:2454] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0cf45bc1f6ca4930a78a657981083522 in term 0.
I20260808 05:11:52.300868 9476 raft_consensus.cc:2781] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:11:52.300930 9476 raft_consensus.cc:482] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:11:52.300945 9476 raft_consensus.cc:3037] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:52.301687 9476 raft_consensus.cc:504] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.301800 9476 leader_election.cc:288] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [CANDIDATE]: Term 1 election: Requested vote from peers 176d13a638ad463db56263cc1229a519 (127.12.251.1:34217), a008567e45224644a3ae014ce7823908 (127.12.251.3:37687)
I20260808 05:11:52.301970 8954 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0262805e4a744d16a8f61516152b312b" candidate_uuid: "0cf45bc1f6ca4930a78a657981083522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "176d13a638ad463db56263cc1229a519"
I20260808 05:11:52.301996 9374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0262805e4a744d16a8f61516152b312b" candidate_uuid: "0cf45bc1f6ca4930a78a657981083522" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a008567e45224644a3ae014ce7823908"
I20260808 05:11:52.302057 9374 raft_consensus.cc:3037] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:52.302057 8954 raft_consensus.cc:3037] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:52.302758 9374 raft_consensus.cc:2454] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cf45bc1f6ca4930a78a657981083522 in term 1.
I20260808 05:11:52.302793 8954 raft_consensus.cc:2454] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0cf45bc1f6ca4930a78a657981083522 in term 1.
I20260808 05:11:52.302909 9063 leader_election.cc:302] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0cf45bc1f6ca4930a78a657981083522, a008567e45224644a3ae014ce7823908; no voters:
I20260808 05:11:52.303010 9476 raft_consensus.cc:2781] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:52.303167 9476 raft_consensus.cc:686] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 1 LEADER]: Becoming Leader. State: Replica: 0cf45bc1f6ca4930a78a657981083522, State: Running, Role: LEADER
I20260808 05:11:52.303264 9476 consensus_queue.cc:237] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } }
I20260808 05:11:52.304069 8729 catalog_manager.cc:5495] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0cf45bc1f6ca4930a78a657981083522 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "0cf45bc1f6ca4930a78a657981083522" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0cf45bc1f6ca4930a78a657981083522" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 34055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 } health_report { overall_health: UNKNOWN } } }
I20260808 05:11:52.312367 9457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.310406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55982 (local address 127.12.251.2:34055)
0808 05:11:52.310456 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:52.310458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:52.310466 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:11:52.310496 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:52.310496 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:52.310513 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:52.310568 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:52.310698 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.311131 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.311802 (+ 671us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:52.311976 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:52.312016 (+ 40us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:52.312119 (+ 103us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:52.312200 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:11:52.312260 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:52.312278 (+ 18us) server_negotiation.cc:299] Negotiation successful
0808 05:11:52.312285 (+ 7us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:11:52.313985 8954 raft_consensus.cc:1261] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 1 FOLLOWER]: Refusing update from remote peer 0cf45bc1f6ca4930a78a657981083522: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:52.313985 9374 raft_consensus.cc:1261] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 1 FOLLOWER]: Refusing update from remote peer 0cf45bc1f6ca4930a78a657981083522: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:52.314294 9481 consensus_queue.cc:1035] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a008567e45224644a3ae014ce7823908" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 37687 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:52.314436 9476 consensus_queue.cc:1035] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [LEADER]: Connected to new peer: Peer: permanent_uuid: "176d13a638ad463db56263cc1229a519" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 34217 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:52.316512 9486 mvcc.cc:205] Tried to move back new op lower bound from 7316135576835661824 to 7316135576794787840. Current Snapshot: MvccSnapshot[applied={T|T < 7316135576835661824}]
I20260808 05:11:52.317198 9487 mvcc.cc:205] Tried to move back new op lower bound from 7316135576835661824 to 7316135576794787840. Current Snapshot: MvccSnapshot[applied={T|T < 7316135576835661824 or (T in {7316135576835661824})}]
I20260808 05:11:52.317250 9488 mvcc.cc:205] Tried to move back new op lower bound from 7316135576835661824 to 7316135576794787840. Current Snapshot: MvccSnapshot[applied={T|T < 7316135576835661824}]
I20260808 05:11:52.319170 8729 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:52.319254 8729 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37756:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:52.319878 8729 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 71433e2197a84e74876ab60b54440bdb: Sending DeleteTablet for 3 replicas of tablet 0262805e4a744d16a8f61516152b312b
I20260808 05:11:52.320187 9132 tablet_service.cc:1514] Processing DeleteTablet for tablet 0262805e4a744d16a8f61516152b312b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:52 UTC) from {username='slave'} at 127.0.0.1:55974
I20260808 05:11:52.320263 9346 tablet_service.cc:1514] Processing DeleteTablet for tablet 0262805e4a744d16a8f61516152b312b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:52 UTC) from {username='slave'} at 127.0.0.1:54820
I20260808 05:11:52.320276 8918 tablet_service.cc:1514] Processing DeleteTablet for tablet 0262805e4a744d16a8f61516152b312b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:52 UTC) from {username='slave'} at 127.0.0.1:57282
I20260808 05:11:52.320469 9504 tablet_replica.cc:330] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519: stopping tablet replica
I20260808 05:11:52.320506 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 8826
I20260808 05:11:52.320568 9504 raft_consensus.cc:2229] T 0262805e4a744d16a8f61516152b312b P 176d13a638ad463db56263cc1229a519 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:52.331415 9497 tablet_replica.cc:330] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: stopping tablet replica
I20260808 05:11:52.331573 9497 raft_consensus.cc:2229] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:11:52.331715 9497 raft_consensus.cc:2258] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:52.331925 9501 tablet_replica.cc:330] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: stopping tablet replica
I20260808 05:11:52.332062 9501 raft_consensus.cc:2229] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:52.332216 9501 raft_consensus.cc:2258] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:52.333539 9497 ts_tablet_manager.cc:1905] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:52.335173 9497 ts_tablet_manager.cc:1918] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:52.335269 9501 ts_tablet_manager.cc:1905] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:52.335299 9497 log.cc:1196] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/0262805e4a744d16a8f61516152b312b
I20260808 05:11:52.335665 9497 ts_tablet_manager.cc:1939] T 0262805e4a744d16a8f61516152b312b P 0cf45bc1f6ca4930a78a657981083522: Deleting consensus metadata
I20260808 05:11:52.336138 8703 catalog_manager.cc:4841] TS 0cf45bc1f6ca4930a78a657981083522 (127.12.251.2:34055): tablet 0262805e4a744d16a8f61516152b312b (table test-table [id=b9101fabd5524a84803ac9e7654e90a6]) successfully deleted
I20260808 05:11:52.336766 9501 ts_tablet_manager.cc:1918] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:52.336838 9501 log.cc:1196] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/0262805e4a744d16a8f61516152b312b
I20260808 05:11:52.337049 9501 ts_tablet_manager.cc:1939] T 0262805e4a744d16a8f61516152b312b P a008567e45224644a3ae014ce7823908: Deleting consensus metadata
I20260808 05:11:52.337428 8706 catalog_manager.cc:4841] TS a008567e45224644a3ae014ce7823908 (127.12.251.3:37687): tablet 0262805e4a744d16a8f61516152b312b (table test-table [id=b9101fabd5524a84803ac9e7654e90a6]) successfully deleted
W20260808 05:11:52.338277 8706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:34217 (error 108)
I20260808 05:11:52.338729 9460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:52.338604 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:34217 (local address 127.0.0.1:57296)
0808 05:11:52.338656 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:52.338695 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:34217: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260808 05:11:52.338810 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 9038
W20260808 05:11:52.344177 8706 catalog_manager.cc:4584] TS 176d13a638ad463db56263cc1229a519 (127.12.251.1:34217): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0262805e4a744d16a8f61516152b312b: Network error: Client connection negotiation failed: client connection to 127.12.251.1:34217: connect: Connection refused (error 111)
I20260808 05:11:52.349079 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 9245
I20260808 05:11:52.359411 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 8682
2026-08-08T05:11:52Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (737 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:11:52 dist-test-slave-bndk krb5kdc[9510](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:11:52 dist-test-slave-bndk krb5kdc[9510](info): set up 2 sockets
Aug 08 05:11:52 dist-test-slave-bndk krb5kdc[9510](info): commencing operation
krb5kdc: starting...
W20260808 05:11:53.486009 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:11:53 dist-test-slave-bndk krb5kdc[9510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:11:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:11:53.601642 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42891
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:42891
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:53.681555 9530 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:53.681756 9530 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:53.681787 9530 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:53.682883 9530 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:53.682921 9530 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:53.682940 9530 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:53.682955 9530 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:53.682968 9530 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:53.684389 9530 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:42891
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42891
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9530
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:53.684624 9530 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:53.684821 9530 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:53.689374 9541 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:53.689494 9530 server_base.cc:1034] running on GCE node
W20260808 05:11:53.689368 9544 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:53.689368 9536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:53.689849 9530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:53.690176 9530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:53.691354 9530 hybrid_clock.cc:648] HybridClock initialized: now 1786165913691334 us; error 43 us; skew 500 ppm
Aug 08 05:11:53 dist-test-slave-bndk krb5kdc[9510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165913, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:53.694375 9530 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:11:53.694855 9530 webserver.cc:460] Webserver started at http://127.12.251.62:38805/ using document root <none> and password file <none>
I20260808 05:11:53.695092 9530 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:53.695151 9530 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:53.695271 9530 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:53.696540 9530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "eb3057b6424c4361a5ae55c326c2a0fc"
format_stamp: "Formatted at 2026-08-08 05:11:53 on dist-test-slave-bndk"
server_key: "1fcac53870f88df5c4148875b5a25dc3"
server_key_iv: "d18a6116b46bc3a2cbeddbcb8f169492"
server_key_version: "encryptionkey@0"
I20260808 05:11:53.696909 9530 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "eb3057b6424c4361a5ae55c326c2a0fc"
format_stamp: "Formatted at 2026-08-08 05:11:53 on dist-test-slave-bndk"
server_key: "1fcac53870f88df5c4148875b5a25dc3"
server_key_iv: "d18a6116b46bc3a2cbeddbcb8f169492"
server_key_version: "encryptionkey@0"
I20260808 05:11:53.698597 9530 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260808 05:11:53.699405 9555 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:53.699584 9530 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:11:53.699678 9530 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "eb3057b6424c4361a5ae55c326c2a0fc"
format_stamp: "Formatted at 2026-08-08 05:11:53 on dist-test-slave-bndk"
server_key: "1fcac53870f88df5c4148875b5a25dc3"
server_key_iv: "d18a6116b46bc3a2cbeddbcb8f169492"
server_key_version: "encryptionkey@0"
I20260808 05:11:53.699754 9530 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:53.725876 9530 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:53.727576 9530 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:53.727691 9530 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:53.731484 9530 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:42891
I20260808 05:11:53.731535 9630 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:42891 every 8 connection(s)
I20260808 05:11:53.731853 9530 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:53.732681 9631 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:53.734974 9631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc: Bootstrap starting.
I20260808 05:11:53.735533 9631 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:53.735795 9631 log.cc:824] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:53.736120 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 9530
I20260808 05:11:53.736227 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:53.736415 13292 external_mini_cluster.cc:1428] Setting key 35e0ef125ad2a7dfee3ea25f9f8877e9
I20260808 05:11:53.736537 9631 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc: No bootstrap required, opened a new log
I20260808 05:11:53.738695 9631 raft_consensus.cc:348] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42891 } }
I20260808 05:11:53.738849 9631 raft_consensus.cc:374] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:53.738873 9631 raft_consensus.cc:729] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb3057b6424c4361a5ae55c326c2a0fc, State: Initialized, Role: FOLLOWER
I20260808 05:11:53.738978 9631 consensus_queue.cc:260] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42891 } }
I20260808 05:11:53.739051 9631 raft_consensus.cc:388] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:53.739085 9631 raft_consensus.cc:482] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:53.739128 9631 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:53.739639 9631 raft_consensus.cc:504] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42891 } }
I20260808 05:11:53.739724 9631 leader_election.cc:302] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eb3057b6424c4361a5ae55c326c2a0fc; no voters:
I20260808 05:11:53.739876 9631 leader_election.cc:288] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:53.739909 9639 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:53.740031 9639 raft_consensus.cc:686] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [term 1 LEADER]: Becoming Leader. State: Replica: eb3057b6424c4361a5ae55c326c2a0fc, State: Running, Role: LEADER
I20260808 05:11:53.740126 9631 sys_catalog.cc:564] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:53.740110 9639 consensus_queue.cc:237] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42891 } }
I20260808 05:11:53.740448 9639 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader eb3057b6424c4361a5ae55c326c2a0fc. Latest consensus state: current_term: 1 leader_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42891 } } }
I20260808 05:11:53.740522 9639 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:53.740722 9646 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:53.741321 9642 sys_catalog.cc:455] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eb3057b6424c4361a5ae55c326c2a0fc" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42891 } } }
I20260808 05:11:53.741421 9642 sys_catalog.cc:458] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc [sys.catalog]: This master's current role is: LEADER
Aug 08 05:11:53 dist-test-slave-bndk krb5kdc[9510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165913, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:53.741338 9646 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:53.745383 9669 mvcc.cc:205] Tried to move back new op lower bound from 7316135582699343872 to 7316135582679904256. Current Snapshot: MvccSnapshot[applied={T|T < 7316135582699343872}]
I20260808 05:11:53.748006 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:53.736924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53120 (local address 127.12.251.62:42891)
0808 05:11:53.737086 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:53.737095 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:53.737122 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:11:53.737800 (+ 678us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:53.737807 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:53.737855 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:53.737984 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:53.738766 (+ 782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:53.740206 (+ 1440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:53.741104 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:53.741835 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:53.741933 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:53.744437 (+ 2504us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:53.744441 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:53.744442 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:53.744454 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:53.746482 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:53.746833 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:53.746837 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:53.746837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:53.746945 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:53.747105 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:53.747106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:53.747106 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:53.747410 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:53.747572 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:53.747650 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 05:11:53.747798 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":73,"threads_started":1}
I20260808 05:11:53.748325 9646 catalog_manager.cc:1347] Generated new cluster ID: c69a91db59f24638a1b75f05511fc08e
I20260808 05:11:53.748375 9646 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:53.771301 9646 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:53.772044 9646 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:53.780141 9646 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc: Generated new TSK 0
I20260808 05:11:53.780342 9646 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.251.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
Entry for principal kudu/127.12.251.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab.
I20260808 05:11:53.813304 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42891
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:53.894570 9675 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:53.894767 9675 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:53.894788 9675 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:53.895946 9675 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:53.895990 9675 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:53.896015 9675 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:53.897467 9675 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.1.keytab
--principal=kudu/127.12.251.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9675
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:53.897653 9675 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:53.897833 9675 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:53.902655 9684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:53.902606 9685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:53.902717 9675 server_base.cc:1034] running on GCE node
W20260808 05:11:53.902614 9688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:53.903069 9675 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:53.903306 9675 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:53.904438 9675 hybrid_clock.cc:648] HybridClock initialized: now 1786165913904428 us; error 26 us; skew 500 ppm
Aug 08 05:11:53 dist-test-slave-bndk krb5kdc[9510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165913, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:53.906951 9675 init.cc:377] Logged in from keytab as kudu/127.12.251.1@KRBTEST.COM (short username kudu)
I20260808 05:11:53.907337 9675 webserver.cc:460] Webserver started at http://127.12.251.1:38391/ using document root <none> and password file <none>
I20260808 05:11:53.907559 9675 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:53.907608 9675 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:53.907733 9675 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:53.908715 9675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "ffb3b24add294fab992ffb506833b8da"
format_stamp: "Formatted at 2026-08-08 05:11:53 on dist-test-slave-bndk"
server_key: "62710d53a60ed2b8ea5d20072fb93753"
server_key_iv: "445acc05cde20f89b7ae9cb282d8463e"
server_key_version: "encryptionkey@0"
I20260808 05:11:53.909031 9675 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "ffb3b24add294fab992ffb506833b8da"
format_stamp: "Formatted at 2026-08-08 05:11:53 on dist-test-slave-bndk"
server_key: "62710d53a60ed2b8ea5d20072fb93753"
server_key_iv: "445acc05cde20f89b7ae9cb282d8463e"
server_key_version: "encryptionkey@0"
I20260808 05:11:53.910269 9675 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:53.910933 9701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:53.911085 9675 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:53.911164 9675 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "ffb3b24add294fab992ffb506833b8da"
format_stamp: "Formatted at 2026-08-08 05:11:53 on dist-test-slave-bndk"
server_key: "62710d53a60ed2b8ea5d20072fb93753"
server_key_iv: "445acc05cde20f89b7ae9cb282d8463e"
server_key_version: "encryptionkey@0"
I20260808 05:11:53.911229 9675 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:53.941033 9675 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:53.942942 9675 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:53.943077 9675 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:53.943282 9675 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:53.943574 9675 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:53.943606 9675 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:53.943635 9675 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:53.943651 9675 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:53.948984 9675 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:37899
I20260808 05:11:53.949055 9873 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:37899 every 8 connection(s)
I20260808 05:11:53.949342 9675 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
Aug 08 05:11:53 dist-test-slave-bndk krb5kdc[9510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165913, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.1@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:53.957902 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:53.950113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:42415 (local address 127.12.251.62:42891)
0808 05:11:53.950174 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:53.950176 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:53.950367 (+ 191us) server_negotiation.cc:407] Connection header received
0808 05:11:53.950870 (+ 503us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:53.950871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:53.950881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:53.950933 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:53.951872 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:53.952379 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:53.953462 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:53.953666 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:53.953719 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:53.955758 (+ 2039us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:53.955760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:53.955760 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:53.955768 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:53.956845 (+ 1077us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:53.957173 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:53.957174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:53.957174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:53.957239 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:53.957425 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:53.957425 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:53.957425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:53.957528 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:53.957573 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:53.957772 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 05:11:53.957836 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:11:53.958132 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 9675
I20260808 05:11:53.958230 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:11:53.958400 13292 external_mini_cluster.cc:1428] Setting key 485b27798c24f892c0770a2d05931d79
I20260808 05:11:53.958678 9876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:53.950067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42891 (local address 127.12.251.1:42415)
0808 05:11:53.950251 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:53.950293 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:53.950767 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:53.950998 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:53.951007 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:53.951601 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:53.951791 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:53.951796 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:53.952466 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:53.952467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:53.953384 (+ 917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:53.953387 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:53.953747 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:53.953748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:53.953881 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:53.954357 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:53.954368 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:53.955674 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:53.956911 (+ 1237us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:53.956917 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:53.956919 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:53.957119 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:53.957279 (+ 160us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:53.957280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:53.957280 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:53.957379 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:53.957570 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:53.957573 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:53.957679 (+ 106us) client_negotiation.cc:769] Sending connection context
0808 05:11:53.957757 (+ 78us) client_negotiation.cc:240] Negotiation successful
0808 05:11:53.957895 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":86,"threads_started":1}
I20260808 05:11:53.959127 9874 heartbeater.cc:347] Connected to a master server at 127.12.251.62:42891
I20260808 05:11:53.959216 9874 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:53.959383 9874 heartbeater.cc:511] Master 127.12.251.62:42891 requested a full tablet report, sending...
I20260808 05:11:53.959918 9581 ts_manager.cc:194] Registered new tserver with Master: ffb3b24add294fab992ffb506833b8da (127.12.251.1:37899)
I20260808 05:11:53.960708 9581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.1@KRBTEST.COM'} at 127.12.251.1:42415
WARNING: no policy specified for kudu/127.12.251.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
Entry for principal kudu/127.12.251.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab.
I20260808 05:11:53.983685 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42891
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:54.065181 9885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:54.065418 9885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:54.065441 9885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:54.066540 9885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:54.066573 9885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:54.066597 9885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:54.068011 9885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.2.keytab
--principal=kudu/127.12.251.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:54.068187 9885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:54.068363 9885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:54.073097 9896 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:54.073140 9885 server_base.cc:1034] running on GCE node
W20260808 05:11:54.073236 9894 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.073143 9892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:54.073580 9885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:54.073796 9885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:54.074923 9885 hybrid_clock.cc:648] HybridClock initialized: now 1786165914074917 us; error 31 us; skew 500 ppm
Aug 08 05:11:54 dist-test-slave-bndk krb5kdc[9510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165914, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:54.077203 9885 init.cc:377] Logged in from keytab as kudu/127.12.251.2@KRBTEST.COM (short username kudu)
I20260808 05:11:54.077600 9885 webserver.cc:460] Webserver started at http://127.12.251.2:34797/ using document root <none> and password file <none>
I20260808 05:11:54.077768 9885 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:54.077805 9885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:54.077896 9885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:54.078846 9885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "53782381a6dc4e14899301d4e1c624b4"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "cd535eee68bda86d9fa7cf95bd912c9f"
server_key_iv: "4e078e153a85bdf57c51ac7910b2e5a8"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.079141 9885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "53782381a6dc4e14899301d4e1c624b4"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "cd535eee68bda86d9fa7cf95bd912c9f"
server_key_iv: "4e078e153a85bdf57c51ac7910b2e5a8"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.080291 9885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:11:54.080891 9910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.081028 9885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.081106 9885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "53782381a6dc4e14899301d4e1c624b4"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "cd535eee68bda86d9fa7cf95bd912c9f"
server_key_iv: "4e078e153a85bdf57c51ac7910b2e5a8"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.081163 9885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:54.110306 9885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:54.112156 9885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:54.112288 9885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:54.112509 9885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:54.112805 9885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:54.112840 9885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.112869 9885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:54.112893 9885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.118561 9885 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:45439
I20260808 05:11:54.118613 10089 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:45439 every 8 connection(s)
I20260808 05:11:54.118914 9885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
Aug 08 05:11:54 dist-test-slave-bndk krb5kdc[9510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165914, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.2@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:54.127104 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.119601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:46195 (local address 127.12.251.62:42891)
0808 05:11:54.119683 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.119686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.119862 (+ 176us) server_negotiation.cc:407] Connection header received
0808 05:11:54.120335 (+ 473us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.120336 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.120346 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.120393 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:54.121342 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.121835 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.122767 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.122946 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.122989 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.124875 (+ 1886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:54.124876 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:54.124877 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:54.124884 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:54.126082 (+ 1198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:54.126419 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:54.126420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:54.126420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:54.126464 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:54.126641 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:54.126641 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:54.126642 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:54.126733 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:54.126777 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.126976 (+ 199us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.127034 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260808 05:11:54.127259 10092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.119580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42891 (local address 127.12.251.2:46195)
0808 05:11:54.119744 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.119780 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.120256 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.120456 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.120460 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.121031 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:54.121270 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.121277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.121898 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.121899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.122707 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.122709 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.122998 (+ 289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.122999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.123094 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.123491 (+ 397us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:54.123510 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:54.124791 (+ 1281us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:54.126145 (+ 1354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:54.126151 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:54.126153 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:54.126362 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:54.126510 (+ 148us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:54.126511 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:54.126511 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:54.126601 (+ 90us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:54.126773 (+ 172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:54.126776 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:54.126883 (+ 107us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.126957 (+ 74us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.127075 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":86,"threads_started":1}
I20260808 05:11:54.127704 10090 heartbeater.cc:347] Connected to a master server at 127.12.251.62:42891
I20260808 05:11:54.127792 10090 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:54.127961 10090 heartbeater.cc:511] Master 127.12.251.62:42891 requested a full tablet report, sending...
I20260808 05:11:54.128300 9581 ts_manager.cc:194] Registered new tserver with Master: 53782381a6dc4e14899301d4e1c624b4 (127.12.251.2:45439)
I20260808 05:11:54.128695 9581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.2@KRBTEST.COM'} at 127.12.251.2:46195
I20260808 05:11:54.128746 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 9885
I20260808 05:11:54.128862 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:11:54.129069 13292 external_mini_cluster.cc:1428] Setting key e77974c442978247b58de5bf97bb06b5
WARNING: no policy specified for kudu/127.12.251.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
Entry for principal kudu/127.12.251.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab.
I20260808 05:11:54.152926 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42891
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:42653
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:54.235248 10098 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:54.235469 10098 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:54.235491 10098 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:54.236609 10098 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:54.236644 10098 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:54.236668 10098 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:54.238093 10098 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:42653
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.3.keytab
--principal=kudu/127.12.251.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:42891
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10098
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:54.238279 10098 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:54.238474 10098 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:54.243460 10105 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.243479 10104 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:54.243510 10098 server_base.cc:1034] running on GCE node
W20260808 05:11:54.243461 10107 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:54.243821 10098 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:54.244025 10098 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:54.245160 10098 hybrid_clock.cc:648] HybridClock initialized: now 1786165914245142 us; error 29 us; skew 500 ppm
Aug 08 05:11:54 dist-test-slave-bndk krb5kdc[9510](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165914, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:54.247547 10098 init.cc:377] Logged in from keytab as kudu/127.12.251.3@KRBTEST.COM (short username kudu)
I20260808 05:11:54.247985 10098 webserver.cc:460] Webserver started at http://127.12.251.3:38203/ using document root <none> and password file <none>
I20260808 05:11:54.248178 10098 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:54.248224 10098 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:54.248351 10098 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:54.249409 10098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "1ed07833da604f7c83549fe23281e4b1"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "cc68fa4880242fd67e059062d0c75773"
server_key_iv: "c3fd823f4c24ba427a32b11e18bd226c"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.249742 10098 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "1ed07833da604f7c83549fe23281e4b1"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "cc68fa4880242fd67e059062d0c75773"
server_key_iv: "c3fd823f4c24ba427a32b11e18bd226c"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.250973 10098 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:11:54.251626 10119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.251783 10098 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:54.251864 10098 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "1ed07833da604f7c83549fe23281e4b1"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "cc68fa4880242fd67e059062d0c75773"
server_key_iv: "c3fd823f4c24ba427a32b11e18bd226c"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.251937 10098 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:54.266716 10098 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:54.268489 10098 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:54.268625 10098 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:54.268836 10098 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:54.269135 10098 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:54.269169 10098 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.269197 10098 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:54.269295 10098 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.274857 10098 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:45593
I20260808 05:11:54.274900 10284 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:45593 every 8 connection(s)
I20260808 05:11:54.275206 10098 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:11:54.277457 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 10098
I20260808 05:11:54.277542 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:11:54.277698 13292 external_mini_cluster.cc:1428] Setting key e642d062aa0e05fc542fba48faed7d59
Aug 08 05:11:54 dist-test-slave-bndk krb5kdc[9510](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165914, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.3@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:11:54.284209 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.275878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:42143 (local address 127.12.251.62:42891)
0808 05:11:54.275935 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.275937 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.276126 (+ 189us) server_negotiation.cc:407] Connection header received
0808 05:11:54.276601 (+ 475us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.276602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.276612 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.276666 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:54.277640 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.278301 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.279308 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.279516 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.279570 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.281664 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:54.281666 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:54.281666 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:54.281675 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:54.282886 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:54.283252 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:54.283253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:54.283254 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:54.283309 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:54.283546 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:54.283547 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:54.283547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:54.283699 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:54.283756 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.284038 (+ 282us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.284120 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:11:54.284368 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.275850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42891 (local address 127.12.251.3:42143)
0808 05:11:54.276003 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.276046 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.276526 (+ 480us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.276720 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.276723 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.277301 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:54.277495 (+ 194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.277507 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.278389 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.278391 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.279228 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.279231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.279583 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.279584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.279703 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.280197 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:11:54.280206 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:54.281578 (+ 1372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:54.282959 (+ 1381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:54.282966 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:54.282969 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:54.283187 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:54.283377 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:11:54.283378 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:11:54.283378 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:11:54.283481 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:11:54.283756 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:54.283764 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:54.283902 (+ 138us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.283991 (+ 89us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.284151 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
I20260808 05:11:54.284885 10287 heartbeater.cc:347] Connected to a master server at 127.12.251.62:42891
I20260808 05:11:54.285010 10287 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:54.285197 10287 heartbeater.cc:511] Master 127.12.251.62:42891 requested a full tablet report, sending...
I20260808 05:11:54.285589 9581 ts_manager.cc:194] Registered new tserver with Master: 1ed07833da604f7c83549fe23281e4b1 (127.12.251.3:45593)
I20260808 05:11:54.285936 9581 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.251.3@KRBTEST.COM'} at 127.12.251.3:42143
I20260808 05:11:54.289379 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:11:54.296200 9637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.290592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53136 (local address 127.12.251.62:42891)
0808 05:11:54.290644 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.290645 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.290800 (+ 155us) server_negotiation.cc:407] Connection header received
0808 05:11:54.290844 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.290845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.290855 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.290928 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:54.291454 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.291976 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.292682 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.292877 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.292930 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.294092 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:54.294093 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:54.294094 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:54.294100 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:54.295113 (+ 1013us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:54.295419 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:54.295420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:54.295420 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:54.295482 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:54.295627 (+ 145us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:54.295628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:54.295628 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:54.295764 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:54.295878 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.296015 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.296102 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:11:54.297789 9581 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53136:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:11:54.299435 9581 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:11:54.305863 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.301996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36316 (local address 127.12.251.1:37899)
0808 05:11:54.302182 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.302187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.302200 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:11:54.302243 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.302246 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.302262 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.302355 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:54.302574 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.303756 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.304883 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.305468 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.305564 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.305629 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.305749 (+ 120us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.305787 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":79,"threads_started":1}
I20260808 05:11:54.305856 10308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.301715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:37899 (local address 127.0.0.1:36316)
0808 05:11:54.302107 (+ 392us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.302114 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.302148 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.302443 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.302445 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.302448 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:54.302495 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.302497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.303870 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.303871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.304802 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.304805 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.305570 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.305571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.305646 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.305660 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.305727 (+ 67us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.305778 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":32,"thread_start_us":97,"threads_started":1}
I20260808 05:11:54.306062 10307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.301708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:45593 (local address 127.0.0.1:38646)
0808 05:11:54.301876 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.301923 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.301990 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.302629 (+ 639us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.302630 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.302632 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:54.302679 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.302680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.303880 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.303881 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.304931 (+ 1050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.304934 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.305823 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.305825 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.305893 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.305897 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.305947 (+ 50us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.305992 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":26,"thread_start_us":86,"threads_started":1}
I20260808 05:11:54.306255 10306 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.301708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:45439 (local address 127.0.0.1:36494)
0808 05:11:54.302084 (+ 376us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.302093 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.302137 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.302369 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.302373 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.302375 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:54.302441 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.302442 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.303451 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.303452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.304651 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.304654 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.306040 (+ 1386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.306042 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.306101 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.306105 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.306152 (+ 47us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.306190 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":362,"mutex_wait_us":2,"thread_start_us":50,"threads_started":1}
I20260808 05:11:54.306278 10310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.301996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38646 (local address 127.12.251.3:45593)
0808 05:11:54.302492 (+ 496us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.302496 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.302506 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:11:54.302540 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.302542 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.302557 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.302631 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:54.302736 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.303783 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.305006 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.305739 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.305801 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.305853 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.306156 (+ 303us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.306203 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":457,"thread_start_us":82,"threads_started":1}
I20260808 05:11:54.306468 10309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.301890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36494 (local address 127.12.251.2:45439)
0808 05:11:54.302203 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.302207 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.302216 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:54.302249 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.302250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.302264 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.302355 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:54.302535 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.303366 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.304733 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.305462 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.305564 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.305629 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.306351 (+ 722us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.306391 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":279,"thread_start_us":99,"threads_started":1}
I20260808 05:11:54.306648 9779 tablet_service.cc:1467] Processing CreateTablet for tablet c1323a67c5614132985b0652ba8a48a2 (DEFAULT_TABLE table=test-table [id=39997abbb23841648cd0c8616e370d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:54.306914 10185 tablet_service.cc:1467] Processing CreateTablet for tablet c1323a67c5614132985b0652ba8a48a2 (DEFAULT_TABLE table=test-table [id=39997abbb23841648cd0c8616e370d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:54.307075 9779 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1323a67c5614132985b0652ba8a48a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:54.307173 10185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1323a67c5614132985b0652ba8a48a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:54.309720 10314 tablet_bootstrap.cc:492] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Bootstrap starting.
I20260808 05:11:54.309862 9983 tablet_service.cc:1467] Processing CreateTablet for tablet c1323a67c5614132985b0652ba8a48a2 (DEFAULT_TABLE table=test-table [id=39997abbb23841648cd0c8616e370d0c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:54.310199 9983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c1323a67c5614132985b0652ba8a48a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:54.310379 10314 tablet_bootstrap.cc:654] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:54.310966 10314 log.cc:824] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:54.311816 10314 tablet_bootstrap.cc:492] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: No bootstrap required, opened a new log
I20260808 05:11:54.311894 10314 ts_tablet_manager.cc:1397] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:54.313504 10316 tablet_bootstrap.cc:492] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da: Bootstrap starting.
I20260808 05:11:54.313817 10318 tablet_bootstrap.cc:492] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: Bootstrap starting.
I20260808 05:11:54.313906 10314 raft_consensus.cc:348] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.314086 10314 raft_consensus.cc:374] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:54.314131 10314 raft_consensus.cc:729] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1ed07833da604f7c83549fe23281e4b1, State: Initialized, Role: FOLLOWER
I20260808 05:11:54.314263 10314 consensus_queue.cc:260] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.314339 10316 tablet_bootstrap.cc:654] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:54.314445 10318 tablet_bootstrap.cc:654] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:54.314555 10314 ts_tablet_manager.cc:1428] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:54.314679 10287 heartbeater.cc:503] Master 127.12.251.62:42891 was elected leader, sending a full tablet report...
I20260808 05:11:54.314854 10316 log.cc:824] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:54.314970 10318 log.cc:824] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:54.315631 10316 tablet_bootstrap.cc:492] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da: No bootstrap required, opened a new log
I20260808 05:11:54.315706 10316 ts_tablet_manager.cc:1397] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:54.315973 10318 tablet_bootstrap.cc:492] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: No bootstrap required, opened a new log
I20260808 05:11:54.316043 10318 ts_tablet_manager.cc:1397] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:54.317144 10316 raft_consensus.cc:348] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.317329 10316 raft_consensus.cc:374] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:54.317374 10316 raft_consensus.cc:729] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ffb3b24add294fab992ffb506833b8da, State: Initialized, Role: FOLLOWER
I20260808 05:11:54.317492 10316 consensus_queue.cc:260] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.317451 10318 raft_consensus.cc:348] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.317615 10318 raft_consensus.cc:374] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:54.317654 10318 raft_consensus.cc:729] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53782381a6dc4e14899301d4e1c624b4, State: Initialized, Role: FOLLOWER
I20260808 05:11:54.317757 10316 ts_tablet_manager.cc:1428] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:54.317803 9874 heartbeater.cc:503] Master 127.12.251.62:42891 was elected leader, sending a full tablet report...
I20260808 05:11:54.317764 10318 consensus_queue.cc:260] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.318027 10318 ts_tablet_manager.cc:1428] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260808 05:11:54.318035 10090 heartbeater.cc:503] Master 127.12.251.62:42891 was elected leader, sending a full tablet report...
W20260808 05:11:54.369462 10091 tablet.cc:2369] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260808 05:11:54.450022 9875 tablet.cc:2369] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:11:54.503669 10320 raft_consensus.cc:482] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:54.503809 10320 raft_consensus.cc:504] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.504204 10320 leader_election.cc:288] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ffb3b24add294fab992ffb506833b8da (127.12.251.1:37899), 53782381a6dc4e14899301d4e1c624b4 (127.12.251.2:45439)
I20260808 05:11:54.506978 10291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.504394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:37899 (local address 127.12.251.3:51083)
0808 05:11:54.504438 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.504449 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.504495 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.504661 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.504663 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.504665 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:54.504737 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.504740 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.505456 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.505457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.506213 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.506216 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.506746 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.506747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.506820 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.506824 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.506873 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.506911 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 05:11:54.507007 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.504439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:51083 (local address 127.12.251.1:37899)
0808 05:11:54.504515 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.504518 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.504531 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:11:54.504562 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.504563 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.504575 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.504643 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:54.504828 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.505385 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.506300 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.506677 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.506732 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.506740 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.506883 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.506922 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260808 05:11:54.507058 10309 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.504483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:52673 (local address 127.12.251.2:45439)
0808 05:11:54.504525 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.504526 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.504710 (+ 184us) server_negotiation.cc:407] Connection header received
0808 05:11:54.504746 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.504747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.504757 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.504809 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:54.504962 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.505474 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.506375 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.506757 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.506822 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.506830 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.506967 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.506998 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260808 05:11:54.507121 10329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.504394 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:45439 (local address 127.12.251.3:52673)
0808 05:11:54.504657 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.504665 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.504710 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.504826 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.504827 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.504829 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:54.504898 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.504899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.505550 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.505550 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.506304 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.506307 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.506834 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.506834 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.506899 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.506903 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.506954 (+ 51us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.506991 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":250,"mutex_wait_us":96,"thread_start_us":112,"threads_started":1}
I20260808 05:11:54.507359 9806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1323a67c5614132985b0652ba8a48a2" candidate_uuid: "1ed07833da604f7c83549fe23281e4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb3b24add294fab992ffb506833b8da" is_pre_election: true
I20260808 05:11:54.507479 10328 raft_consensus.cc:482] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:54.507519 9806 raft_consensus.cc:2454] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ed07833da604f7c83549fe23281e4b1 in term 0.
I20260808 05:11:54.507530 10017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1323a67c5614132985b0652ba8a48a2" candidate_uuid: "1ed07833da604f7c83549fe23281e4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53782381a6dc4e14899301d4e1c624b4" is_pre_election: true
I20260808 05:11:54.507575 10328 raft_consensus.cc:504] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.507663 10017 raft_consensus.cc:2454] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1ed07833da604f7c83549fe23281e4b1 in term 0.
I20260808 05:11:54.507764 10122 leader_election.cc:302] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ed07833da604f7c83549fe23281e4b1, ffb3b24add294fab992ffb506833b8da; no voters:
I20260808 05:11:54.507853 10328 leader_election.cc:288] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1ed07833da604f7c83549fe23281e4b1 (127.12.251.3:45593), ffb3b24add294fab992ffb506833b8da (127.12.251.1:37899)
I20260808 05:11:54.507946 10320 raft_consensus.cc:2781] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:11:54.507989 10320 raft_consensus.cc:482] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:11:54.508010 10320 raft_consensus.cc:3037] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:54.508888 10320 raft_consensus.cc:504] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.509023 10320 leader_election.cc:288] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [CANDIDATE]: Term 1 election: Requested vote from peers ffb3b24add294fab992ffb506833b8da (127.12.251.1:37899), 53782381a6dc4e14899301d4e1c624b4 (127.12.251.2:45439)
I20260808 05:11:54.509271 9806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1323a67c5614132985b0652ba8a48a2" candidate_uuid: "1ed07833da604f7c83549fe23281e4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb3b24add294fab992ffb506833b8da"
I20260808 05:11:54.509284 10017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1323a67c5614132985b0652ba8a48a2" candidate_uuid: "1ed07833da604f7c83549fe23281e4b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53782381a6dc4e14899301d4e1c624b4"
I20260808 05:11:54.509349 9806 raft_consensus.cc:3037] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:54.509361 10017 raft_consensus.cc:3037] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:54.510177 10017 raft_consensus.cc:2454] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ed07833da604f7c83549fe23281e4b1 in term 1.
I20260808 05:11:54.510236 9806 raft_consensus.cc:2454] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1ed07833da604f7c83549fe23281e4b1 in term 1.
I20260808 05:11:54.510351 10121 leader_election.cc:302] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1ed07833da604f7c83549fe23281e4b1, 53782381a6dc4e14899301d4e1c624b4; no voters:
I20260808 05:11:54.510537 10320 raft_consensus.cc:2781] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:54.510663 10320 raft_consensus.cc:686] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 1 LEADER]: Becoming Leader. State: Replica: 1ed07833da604f7c83549fe23281e4b1, State: Running, Role: LEADER
I20260808 05:11:54.510748 10320 consensus_queue.cc:237] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } }
I20260808 05:11:54.511142 10310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.508362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:40763 (local address 127.12.251.3:45593)
0808 05:11:54.508409 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.508411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.508418 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:11:54.508461 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.508462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.508469 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.508519 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:54.508652 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.509105 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.510366 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.510817 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.510863 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.510870 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.511062 (+ 192us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.511092 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:11:54.511184 10092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.508004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:37899 (local address 127.12.251.2:37547)
0808 05:11:54.508186 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.508194 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.508237 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.508416 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.508417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.508420 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:54.508485 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.508486 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.509256 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.509257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.510269 (+ 1012us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.510271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.510938 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.510939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.511015 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.511018 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.511066 (+ 48us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.511101 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":3}
I20260808 05:11:54.511371 10313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.508061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:37547 (local address 127.12.251.1:37899)
0808 05:11:54.508146 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.508148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.508230 (+ 82us) server_negotiation.cc:407] Connection header received
0808 05:11:54.508281 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.508282 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.508290 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.508337 (+ 47us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:54.508570 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.509153 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.510353 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.510833 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.510899 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.510906 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.511264 (+ 358us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.511317 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260808 05:11:54.511535 9806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1323a67c5614132985b0652ba8a48a2" candidate_uuid: "53782381a6dc4e14899301d4e1c624b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ffb3b24add294fab992ffb506833b8da" is_pre_election: true
I20260808 05:11:54.511621 9806 raft_consensus.cc:2379] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53782381a6dc4e14899301d4e1c624b4 in current term 1: Already voted for candidate 1ed07833da604f7c83549fe23281e4b1 in this term.
I20260808 05:11:54.511595 9581 catalog_manager.cc:5495] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1ed07833da604f7c83549fe23281e4b1 (127.12.251.3). New cstate: current_term: 1 leader_uuid: "1ed07833da604f7c83549fe23281e4b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1ed07833da604f7c83549fe23281e4b1" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 45593 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 } health_report { overall_health: UNKNOWN } } }
I20260808 05:11:54.511811 10330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.508040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:45593 (local address 127.12.251.2:40763)
0808 05:11:54.508368 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.508377 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.508415 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.508527 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.508528 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.508529 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:54.508596 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.508597 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.509186 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.509187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.510267 (+ 1080us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.510271 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.510926 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.510927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.511003 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.511006 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.511050 (+ 44us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.511084 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":313,"thread_start_us":112,"threads_started":1}
I20260808 05:11:54.512097 10212 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c1323a67c5614132985b0652ba8a48a2" candidate_uuid: "53782381a6dc4e14899301d4e1c624b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1ed07833da604f7c83549fe23281e4b1" is_pre_election: true
I20260808 05:11:54.512378 9915 leader_election.cc:302] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53782381a6dc4e14899301d4e1c624b4; no voters: 1ed07833da604f7c83549fe23281e4b1, ffb3b24add294fab992ffb506833b8da
I20260808 05:11:54.512508 10328 raft_consensus.cc:2726] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260808 05:11:54.525720 10290 tablet.cc:2369] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:11:54.529690 10310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.527613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38656 (local address 127.12.251.3:45593)
0808 05:11:54.527662 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.527664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.527688 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:11:54.527756 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.527756 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.527770 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.527823 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:54.527946 (+ 123us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.528377 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.529089 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.529300 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.529346 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.529443 (+ 97us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:54.529541 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:11:54.529595 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.529610 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.529623 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260808 05:11:54.531234 9806 raft_consensus.cc:1261] T c1323a67c5614132985b0652ba8a48a2 P ffb3b24add294fab992ffb506833b8da [term 1 FOLLOWER]: Refusing update from remote peer 1ed07833da604f7c83549fe23281e4b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:54.531253 10017 raft_consensus.cc:1261] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 1 FOLLOWER]: Refusing update from remote peer 1ed07833da604f7c83549fe23281e4b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:54.531544 10320 consensus_queue.cc:1035] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ffb3b24add294fab992ffb506833b8da" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 37899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:54.531670 10331 consensus_queue.cc:1035] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53782381a6dc4e14899301d4e1c624b4" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 45439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:54.534158 10338 mvcc.cc:205] Tried to move back new op lower bound from 7316135585917620224 to 7316135585836675072. Current Snapshot: MvccSnapshot[applied={T|T < 7316135585917620224}]
I20260808 05:11:54.534534 10340 mvcc.cc:205] Tried to move back new op lower bound from 7316135585917620224 to 7316135585836675072. Current Snapshot: MvccSnapshot[applied={T|T < 7316135585917620224}]
I20260808 05:11:54.536651 9581 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:54.536746 9581 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53136:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:54.537467 9581 catalog_manager.cc:5782] T 00000000000000000000000000000000 P eb3057b6424c4361a5ae55c326c2a0fc: Sending DeleteTablet for 3 replicas of tablet c1323a67c5614132985b0652ba8a48a2
I20260808 05:11:54.537740 10185 tablet_service.cc:1514] Processing DeleteTablet for tablet c1323a67c5614132985b0652ba8a48a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:54 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:38646
I20260808 05:11:54.537806 9983 tablet_service.cc:1514] Processing DeleteTablet for tablet c1323a67c5614132985b0652ba8a48a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:54 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36494
I20260808 05:11:54.537866 9779 tablet_service.cc:1514] Processing DeleteTablet for tablet c1323a67c5614132985b0652ba8a48a2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:54 UTC) from {username='kudu', principal='kudu/127.12.251.62@KRBTEST.COM'} at 127.0.0.1:36316
I20260808 05:11:54.538051 10352 tablet_replica.cc:330] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: stopping tablet replica
I20260808 05:11:54.538156 10352 raft_consensus.cc:2229] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:54.538254 10352 raft_consensus.cc:2258] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:54.538277 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 9675
W20260808 05:11:54.551050 9557 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:37899 (error 108)
I20260808 05:11:54.551226 10351 tablet_replica.cc:330] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: stopping tablet replica
I20260808 05:11:54.551379 10351 raft_consensus.cc:2229] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:11:54.551510 10351 raft_consensus.cc:2258] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:54.551760 10352 ts_tablet_manager.cc:1905] T c1323a67c5614132985b0652ba8a48a2 P 53782381a6dc4e14899301d4e1c624b4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:54.551959 10308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.551821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:37899 (local address 127.0.0.1:36324)
0808 05:11:54.551865 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.551907 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:37899: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260808 05:11:54.551957 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 9885
I20260808 05:11:54.551975 10351 ts_tablet_manager.cc:1905] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:54.555409 10351 ts_tablet_manager.cc:1918] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:54.555477 10351 log.cc:1196] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/c1323a67c5614132985b0652ba8a48a2
I20260808 05:11:54.555742 10351 ts_tablet_manager.cc:1939] T c1323a67c5614132985b0652ba8a48a2 P 1ed07833da604f7c83549fe23281e4b1: Deleting consensus metadata
I20260808 05:11:54.556134 9559 catalog_manager.cc:4841] TS 1ed07833da604f7c83549fe23281e4b1 (127.12.251.3:45593): tablet c1323a67c5614132985b0652ba8a48a2 (table test-table [id=39997abbb23841648cd0c8616e370d0c]) successfully deleted
W20260808 05:11:54.560827 9557 catalog_manager.cc:4584] TS ffb3b24add294fab992ffb506833b8da (127.12.251.1:37899): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c1323a67c5614132985b0652ba8a48a2: Network error: Client connection negotiation failed: client connection to 127.12.251.1:37899: connect: Connection refused (error 111)
I20260808 05:11:54.567900 10308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.567786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:45439 (local address 127.0.0.1:36504)
0808 05:11:54.567832 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.567861 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.2:45439: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260808 05:11:54.567907 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 10098
I20260808 05:11:54.576172 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 9530
2026-08-08T05:11:54Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2221 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-08T05:11:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:54Z Disabled control of system clock
I20260808 05:11:54.613139 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36821
--webserver_interface=127.12.251.62
--webserver_port=0
--builtin_ntp_servers=127.12.251.20:43369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:36821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:54.693372 10366 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:54.693612 10366 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:54.693632 10366 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:54.694730 10366 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:54.694764 10366 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:54.694775 10366 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:54.694785 10366 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:54.694796 10366 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:54.696063 10366 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:36821
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:36821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10366
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:54.696249 10366 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:54.696511 10366 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:54.700984 10372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.701038 10375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.701046 10373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:54.701131 10366 server_base.cc:1034] running on GCE node
I20260808 05:11:54.701480 10366 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:54.701735 10366 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:54.702872 10366 hybrid_clock.cc:648] HybridClock initialized: now 1786165914702857 us; error 32 us; skew 500 ppm
I20260808 05:11:54.703938 10366 webserver.cc:460] Webserver started at http://127.12.251.62:45915/ using document root <none> and password file <none>
I20260808 05:11:54.704161 10366 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:54.704206 10366 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:54.704339 10366 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:54.705412 10366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "1d253feb6e8a40c8b8beedf1b9fc4672"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "e564749bc83572448d577b37c1d1afbd"
server_key_iv: "37d0a199e506672ac7b6f31aae8f29e2"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.705814 10366 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "1d253feb6e8a40c8b8beedf1b9fc4672"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "e564749bc83572448d577b37c1d1afbd"
server_key_iv: "37d0a199e506672ac7b6f31aae8f29e2"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.707078 10366 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:11:54.707691 10384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.707829 10366 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:54.707908 10366 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "1d253feb6e8a40c8b8beedf1b9fc4672"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "e564749bc83572448d577b37c1d1afbd"
server_key_iv: "37d0a199e506672ac7b6f31aae8f29e2"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.707966 10366 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:54.731151 10366 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:54.731508 10366 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:54.731642 10366 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:54.735323 10366 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:36821
I20260808 05:11:54.735359 10467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:36821 every 8 connection(s)
I20260808 05:11:54.735678 10366 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:54.736634 10470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:54.737434 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 10366
I20260808 05:11:54.737527 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:54.737716 13292 external_mini_cluster.cc:1428] Setting key cf4e5eb1e21f586ea77d511debfb8597
I20260808 05:11:54.739785 10470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672: Bootstrap starting.
I20260808 05:11:54.740475 10470 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:54.740782 10470 log.cc:824] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:54.741497 10470 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672: No bootstrap required, opened a new log
I20260808 05:11:54.743414 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.738215 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41580 (local address 127.12.251.62:36821)
0808 05:11:54.738420 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.738429 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.738463 (+ 34us) server_negotiation.cc:407] Connection header received
0808 05:11:54.738937 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.738946 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.739034 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.739185 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:54.739339 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.740633 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.741421 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.742005 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.742133 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.742720 (+ 587us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:54.742724 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:54.742724 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:54.742920 (+ 196us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:54.742980 (+ 60us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:54.742995 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:54.743061 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.743111 (+ 50us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.743193 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":77,"threads_started":1}
I20260808 05:11:54.743669 10470 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36821 } }
I20260808 05:11:54.743813 10470 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:54.743855 10470 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d253feb6e8a40c8b8beedf1b9fc4672, State: Initialized, Role: FOLLOWER
I20260808 05:11:54.743971 10470 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36821 } }
I20260808 05:11:54.744050 10470 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:54.744081 10470 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:54.744122 10470 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:54.744618 10470 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36821 } }
I20260808 05:11:54.744707 10470 leader_election.cc:302] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d253feb6e8a40c8b8beedf1b9fc4672; no voters:
I20260808 05:11:54.744869 10470 leader_election.cc:288] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:54.744925 10477 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:54.745085 10477 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [term 1 LEADER]: Becoming Leader. State: Replica: 1d253feb6e8a40c8b8beedf1b9fc4672, State: Running, Role: LEADER
I20260808 05:11:54.745116 10470 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:54.745173 10477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36821 } }
I20260808 05:11:54.745607 10481 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d253feb6e8a40c8b8beedf1b9fc4672. Latest consensus state: current_term: 1 leader_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36821 } } }
I20260808 05:11:54.745617 10480 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d253feb6e8a40c8b8beedf1b9fc4672" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 36821 } } }
I20260808 05:11:54.745697 10481 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:54.745739 10480 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:54.745939 10490 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:54.746420 10490 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:54.747768 10490 catalog_manager.cc:1347] Generated new cluster ID: 1a19f0d460094ae1bd9d2235b054e24e
I20260808 05:11:54.747820 10490 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:54.760859 10490 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:54.761409 10490 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:54.764077 10490 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672: Generated new TSK 0
I20260808 05:11:54.764231 10490 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:11:54.769397 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.1:0
--local_ip_for_outbound_sockets=127.12.251.1
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36821
--builtin_ntp_servers=127.12.251.20:43369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:54.850841 10509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:54.851053 10509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:54.851083 10509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:54.852202 10509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:54.852239 10509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:54.852272 10509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.1
I20260808 05:11:54.853580 10509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.251.1
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10509
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.1
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:54.853793 10509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:54.854063 10509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:54.858877 10515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.858950 10518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.858877 10516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:54.859119 10509 server_base.cc:1034] running on GCE node
I20260808 05:11:54.859314 10509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:54.859545 10509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:54.860692 10509 hybrid_clock.cc:648] HybridClock initialized: now 1786165914860674 us; error 29 us; skew 500 ppm
I20260808 05:11:54.861953 10509 webserver.cc:460] Webserver started at http://127.12.251.1:38211/ using document root <none> and password file <none>
I20260808 05:11:54.862191 10509 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:54.862236 10509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:54.862375 10509 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:54.863417 10509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data/instance:
uuid: "dda3eed9da79493fb5d3b4eafe681160"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "4a7e109019c6dfc575de225c84615306"
server_key_iv: "6a7ba433bc3c9ec29d6555b9f835a10a"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.863749 10509 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance:
uuid: "dda3eed9da79493fb5d3b4eafe681160"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "4a7e109019c6dfc575de225c84615306"
server_key_iv: "6a7ba433bc3c9ec29d6555b9f835a10a"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.865037 10509 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:11:54.865783 10531 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.865929 10509 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.866007 10509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/wal
uuid: "dda3eed9da79493fb5d3b4eafe681160"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "4a7e109019c6dfc575de225c84615306"
server_key_iv: "6a7ba433bc3c9ec29d6555b9f835a10a"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.866077 10509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:54.887887 10509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:54.888190 10509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:54.888322 10509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:54.888561 10509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:54.888880 10509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:54.888914 10509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.888942 10509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:54.888960 10509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:54.894495 10509 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.1:33477
I20260808 05:11:54.894548 10703 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.1:33477 every 8 connection(s)
I20260808 05:11:54.894862 10509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/data/info.pb
I20260808 05:11:54.900130 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.895545 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.1:37655 (local address 127.12.251.62:36821)
0808 05:11:54.895608 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:54.895610 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:54.895843 (+ 233us) server_negotiation.cc:407] Connection header received
0808 05:11:54.896368 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:54.896369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:54.896387 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:54.896443 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:54.897201 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.897756 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.898735 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.898933 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.898990 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.899849 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:54.899851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:54.899852 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:54.899857 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:54.899876 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:54.899880 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:54.899922 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:54.900013 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 05:11:54.900047 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:11:54.900333 10706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:54.895533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36821 (local address 127.12.251.1:37655)
0808 05:11:54.895721 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:54.895756 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:54.896259 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:54.896514 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:54.896517 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:54.896527 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:54.897106 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.897113 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.897851 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.897852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.898643 (+ 791us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:54.898646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:54.899003 (+ 357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:54.899004 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:54.899131 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:54.899661 (+ 530us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:54.899662 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:54.899696 (+ 34us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:54.899721 (+ 25us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:54.899939 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:54.899945 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:54.899949 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:54.900009 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:11:54.900120 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":81,"threads_started":1}
I20260808 05:11:54.900795 10704 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36821
I20260808 05:11:54.900884 10704 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:54.901051 10704 heartbeater.cc:511] Master 127.12.251.62:36821 requested a full tablet report, sending...
I20260808 05:11:54.901583 10408 ts_manager.cc:194] Registered new tserver with Master: dda3eed9da79493fb5d3b4eafe681160 (127.12.251.1:33477)
I20260808 05:11:54.902170 10408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.1:37655
I20260808 05:11:54.904918 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 10509
I20260808 05:11:54.905019 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-0/wal/instance
I20260808 05:11:54.905192 13292 external_mini_cluster.cc:1428] Setting key 60543aba33ecf5ef5ff40876ae4b792c
I20260808 05:11:54.906044 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.2:0
--local_ip_for_outbound_sockets=127.12.251.2
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36821
--builtin_ntp_servers=127.12.251.20:43369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:54.986975 10709 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:54.987179 10709 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:54.987210 10709 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:54.988303 10709 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:54.988348 10709 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:54.988380 10709 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.2
I20260808 05:11:54.989686 10709 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.251.2
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10709
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.2
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:54.989921 10709 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:54.990186 10709 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:54.994967 10717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.994973 10718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:54.994973 10721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:54.995234 10709 server_base.cc:1034] running on GCE node
I20260808 05:11:54.995431 10709 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:54.995651 10709 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:54.996835 10709 hybrid_clock.cc:648] HybridClock initialized: now 1786165914996819 us; error 30 us; skew 500 ppm
I20260808 05:11:54.998082 10709 webserver.cc:460] Webserver started at http://127.12.251.2:45829/ using document root <none> and password file <none>
I20260808 05:11:54.998304 10709 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:54.998353 10709 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:54.998484 10709 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:54.999488 10709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data/instance:
uuid: "42a4ef97eb08475882fcdf8d80cd6db5"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "a77ccc40c08e5beaa2f506d173c93ff2"
server_key_iv: "f6d66e61ca770b9838a42c3abd5e2186"
server_key_version: "encryptionkey@0"
I20260808 05:11:54.999876 10709 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance:
uuid: "42a4ef97eb08475882fcdf8d80cd6db5"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "a77ccc40c08e5beaa2f506d173c93ff2"
server_key_iv: "f6d66e61ca770b9838a42c3abd5e2186"
server_key_version: "encryptionkey@0"
I20260808 05:11:55.001152 10709 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:11:55.001848 10728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:55.002002 10709 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:55.002086 10709 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal
uuid: "42a4ef97eb08475882fcdf8d80cd6db5"
format_stamp: "Formatted at 2026-08-08 05:11:54 on dist-test-slave-bndk"
server_key: "a77ccc40c08e5beaa2f506d173c93ff2"
server_key_iv: "f6d66e61ca770b9838a42c3abd5e2186"
server_key_version: "encryptionkey@0"
I20260808 05:11:55.002146 10709 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:55.025995 10709 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:55.026279 10709 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:55.026403 10709 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:55.026619 10709 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:55.026940 10709 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:55.026974 10709 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:55.027004 10709 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:55.027027 10709 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:55.032555 10709 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.2:32927
I20260808 05:11:55.032610 10891 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.2:32927 every 8 connection(s)
I20260808 05:11:55.032912 10709 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/data/info.pb
I20260808 05:11:55.037712 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.033633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:54485 (local address 127.12.251.62:36821)
0808 05:11:55.033691 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.033693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.033901 (+ 208us) server_negotiation.cc:407] Connection header received
0808 05:11:55.034407 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.034408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.034419 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.034481 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:55.035111 (+ 630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.035597 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.036510 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.036685 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.036727 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.037486 (+ 759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:55.037487 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:55.037487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:55.037492 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:55.037516 (+ 24us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:55.037521 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:55.037562 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.037622 (+ 60us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.037650 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260808 05:11:55.037881 10896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.033606 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36821 (local address 127.12.251.2:54485)
0808 05:11:55.033788 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.033827 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:55.034326 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:55.034536 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:55.034540 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:55.034548 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:55.035048 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.035052 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.035676 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.035676 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.036443 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.036445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.036738 (+ 293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.036738 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.036838 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.037355 (+ 517us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:55.037356 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:55.037384 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:55.037406 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:55.037568 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:55.037571 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:55.037573 (+ 2us) client_negotiation.cc:769] Sending connection context
0808 05:11:55.037619 (+ 46us) client_negotiation.cc:240] Negotiation successful
0808 05:11:55.037695 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":68,"threads_started":1}
I20260808 05:11:55.038334 10893 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36821
I20260808 05:11:55.038421 10893 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:55.038599 10893 heartbeater.cc:511] Master 127.12.251.62:36821 requested a full tablet report, sending...
I20260808 05:11:55.038947 10408 ts_manager.cc:194] Registered new tserver with Master: 42a4ef97eb08475882fcdf8d80cd6db5 (127.12.251.2:32927)
I20260808 05:11:55.039290 10408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.2:54485
I20260808 05:11:55.041324 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 10709
I20260808 05:11:55.041414 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal/instance
I20260808 05:11:55.041591 13292 external_mini_cluster.cc:1428] Setting key 8d56e66aeaa471c088df2cfb59e315d8
I20260808 05:11:55.042428 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.251.3:0
--local_ip_for_outbound_sockets=127.12.251.3
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36821
--builtin_ntp_servers=127.12.251.20:43369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260808 05:11:55.122920 10898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:55.123242 10898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:55.123265 10898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:55.124432 10898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:55.124475 10898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:55.124497 10898 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.251.3
I20260808 05:11:55.125878 10898 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:43369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.251.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.251.3
--webserver_port=0
--tserver_master_addrs=127.12.251.62:36821
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.251.3
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:55.126065 10898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:55.126304 10898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260808 05:11:55.131162 10898 server_base.cc:1034] running on GCE node
W20260808 05:11:55.131081 10905 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:55.131094 10910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:55.131078 10906 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:55.131505 10898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:55.131705 10898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:55.132843 10898 hybrid_clock.cc:648] HybridClock initialized: now 1786165915132831 us; error 29 us; skew 500 ppm
I20260808 05:11:55.134025 10898 webserver.cc:460] Webserver started at http://127.12.251.3:39529/ using document root <none> and password file <none>
I20260808 05:11:55.134232 10898 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:55.134279 10898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:55.134399 10898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:55.135404 10898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data/instance:
uuid: "546083657841475fb96becc6f6366bc9"
format_stamp: "Formatted at 2026-08-08 05:11:55 on dist-test-slave-bndk"
server_key: "a0e655770cc1a832eb749099576f22e3"
server_key_iv: "bce38ac4ea828258735f20f63b9761e7"
server_key_version: "encryptionkey@0"
I20260808 05:11:55.135728 10898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance:
uuid: "546083657841475fb96becc6f6366bc9"
format_stamp: "Formatted at 2026-08-08 05:11:55 on dist-test-slave-bndk"
server_key: "a0e655770cc1a832eb749099576f22e3"
server_key_iv: "bce38ac4ea828258735f20f63b9761e7"
server_key_version: "encryptionkey@0"
I20260808 05:11:55.136952 10898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:11:55.137694 10917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:55.137842 10898 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:55.137921 10898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal
uuid: "546083657841475fb96becc6f6366bc9"
format_stamp: "Formatted at 2026-08-08 05:11:55 on dist-test-slave-bndk"
server_key: "a0e655770cc1a832eb749099576f22e3"
server_key_iv: "bce38ac4ea828258735f20f63b9761e7"
server_key_version: "encryptionkey@0"
I20260808 05:11:55.137986 10898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:55.165771 10898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:55.166081 10898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:55.166210 10898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:55.166424 10898 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260808 05:11:55.166739 10898 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260808 05:11:55.166774 10898 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:55.166801 10898 ts_tablet_manager.cc:610] Registered 0 tablets
I20260808 05:11:55.166822 10898 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:55.172359 10898 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.3:36877
I20260808 05:11:55.172399 11078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.3:36877 every 8 connection(s)
I20260808 05:11:55.172706 10898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/data/info.pb
I20260808 05:11:55.177639 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.173405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.3:49067 (local address 127.12.251.62:36821)
0808 05:11:55.173449 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.173450 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.173702 (+ 252us) server_negotiation.cc:407] Connection header received
0808 05:11:55.174210 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.174211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.174224 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.174274 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:55.174951 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.175440 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.176385 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.176575 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.176631 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.177376 (+ 745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:55.177378 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:55.177378 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:55.177383 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:55.177398 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:55.177401 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:55.177439 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.177531 (+ 92us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.177556 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:11:55.177793 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 10898
I20260808 05:11:55.177902 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal/instance
I20260808 05:11:55.177906 11082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.173395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:36821 (local address 127.12.251.3:49067)
0808 05:11:55.173581 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.173614 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:55.174108 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:55.174361 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:55.174365 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:55.174373 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:11:55.174861 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.174866 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.175533 (+ 667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.175534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.176302 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.176304 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.176648 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.176649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.176769 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.177208 (+ 439us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0808 05:11:55.177209 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:11:55.177273 (+ 64us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0808 05:11:55.177295 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:11:55.177445 (+ 150us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:11:55.177450 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:11:55.177453 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:55.177532 (+ 79us) client_negotiation.cc:240] Negotiation successful
0808 05:11:55.177634 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":78,"threads_started":1}
I20260808 05:11:55.178118 13292 external_mini_cluster.cc:1428] Setting key 8acc7f5d26eb8218c15ebab37d4508c9
I20260808 05:11:55.178431 11079 heartbeater.cc:347] Connected to a master server at 127.12.251.62:36821
I20260808 05:11:55.178529 11079 heartbeater.cc:464] Registering TS with master...
I20260808 05:11:55.178722 11079 heartbeater.cc:511] Master 127.12.251.62:36821 requested a full tablet report, sending...
I20260808 05:11:55.179077 10408 ts_manager.cc:194] Registered new tserver with Master: 546083657841475fb96becc6f6366bc9 (127.12.251.3:36877)
I20260808 05:11:55.179417 10408 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.251.3:49067
I20260808 05:11:55.189734 13292 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260808 05:11:55.193414 10474 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.191030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41582 (local address 127.12.251.62:36821)
0808 05:11:55.191066 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.191067 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.191161 (+ 94us) server_negotiation.cc:407] Connection header received
0808 05:11:55.191202 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.191202 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.191210 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.191252 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:55.191382 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.191822 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.192525 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.192690 (+ 165us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.192729 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.193244 (+ 515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:55.193246 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:55.193246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:55.193250 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:55.193265 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:55.193269 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:55.193308 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.193343 (+ 35us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.193361 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:11:55.194660 10408 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260808 05:11:55.196147 10408 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260808 05:11:55.201937 11092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.198093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.2:32927 (local address 127.0.0.1:57586)
0808 05:11:55.198198 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.198235 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:55.198299 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:55.198668 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:55.198671 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:55.198674 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:55.198731 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.198732 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.199690 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.199691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.200690 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.200692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.201655 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.201656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.201734 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.201748 (+ 14us) client_negotiation.cc:769] Sending connection context
0808 05:11:55.201816 (+ 68us) client_negotiation.cc:240] Negotiation successful
0808 05:11:55.201864 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":83,"mutex_wait_us":1,"thread_start_us":63,"threads_started":1}
I20260808 05:11:55.201984 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.198345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57586 (local address 127.12.251.2:32927)
0808 05:11:55.198521 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.198524 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.198533 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:55.198570 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.198571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.198583 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.198651 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:55.198793 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.199617 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.200846 (+ 1229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.201585 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.201646 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.201737 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.201858 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.201896 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":81,"threads_started":1}
I20260808 05:11:55.202389 11093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.198107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33477 (local address 127.0.0.1:35838)
0808 05:11:55.198255 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.198264 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:55.198301 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:55.198833 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:55.198834 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:55.198836 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:55.198878 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.198879 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.200201 (+ 1322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.200202 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.201259 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.201262 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.202146 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.202147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.202211 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.202215 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:55.202274 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:11:55.202313 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":31,"thread_start_us":89,"threads_started":1}
I20260808 05:11:55.202494 11095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.198108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:36877 (local address 127.0.0.1:53494)
0808 05:11:55.198682 (+ 574us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.198692 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:55.198747 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:55.199014 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:55.199014 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:55.199016 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:55.199048 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.199049 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.200228 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.200229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.201033 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.201036 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.201966 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.201967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.202120 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.202125 (+ 5us) client_negotiation.cc:769] Sending connection context
0808 05:11:55.202241 (+ 116us) client_negotiation.cc:240] Negotiation successful
0808 05:11:55.202285 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":12,"thread_start_us":76,"threads_started":1}
I20260808 05:11:55.202616 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.198334 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53494 (local address 127.12.251.3:36877)
0808 05:11:55.198488 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.198493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.198824 (+ 331us) server_negotiation.cc:407] Connection header received
0808 05:11:55.198861 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.198863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.198876 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.198941 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:55.199129 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.200150 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.201091 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.201779 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.201856 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.201935 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.202357 (+ 422us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.202391 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":78,"threads_started":1}
I20260808 05:11:55.202800 10792 tablet_service.cc:1467] Processing CreateTablet for tablet e5d42c5528d64b2db4b34bc3c4266973 (DEFAULT_TABLE table=test-table [id=fb0ff444d13346c59447fbb3b4ae708b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:55.203126 10792 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5d42c5528d64b2db4b34bc3c4266973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:55.203245 10983 tablet_service.cc:1467] Processing CreateTablet for tablet e5d42c5528d64b2db4b34bc3c4266973 (DEFAULT_TABLE table=test-table [id=fb0ff444d13346c59447fbb3b4ae708b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:55.203609 10983 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5d42c5528d64b2db4b34bc3c4266973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:55.205428 11099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.198518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35838 (local address 127.12.251.1:33477)
0808 05:11:55.198667 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.198672 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.198682 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:11:55.198723 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.198725 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.198739 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.198948 (+ 209us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:55.199010 (+ 62us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.200115 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.201336 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.202036 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.202138 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.202226 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.202290 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.202325 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":71,"threads_started":1}
I20260808 05:11:55.206091 10587 tablet_service.cc:1467] Processing CreateTablet for tablet e5d42c5528d64b2db4b34bc3c4266973 (DEFAULT_TABLE table=test-table [id=fb0ff444d13346c59447fbb3b4ae708b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260808 05:11:55.206373 11101 tablet_bootstrap.cc:492] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Bootstrap starting.
I20260808 05:11:55.206372 11100 tablet_bootstrap.cc:492] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Bootstrap starting.
I20260808 05:11:55.206423 10587 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e5d42c5528d64b2db4b34bc3c4266973. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:55.206863 11101 tablet_bootstrap.cc:654] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:55.207010 11100 tablet_bootstrap.cc:654] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:55.207082 11101 log.cc:824] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:55.207293 11100 log.cc:824] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:55.207829 11101 tablet_bootstrap.cc:492] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: No bootstrap required, opened a new log
I20260808 05:11:55.207875 11101 ts_tablet_manager.cc:1397] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:55.207993 11100 tablet_bootstrap.cc:492] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: No bootstrap required, opened a new log
I20260808 05:11:55.208063 11100 ts_tablet_manager.cc:1397] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:55.209817 11106 tablet_bootstrap.cc:492] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160: Bootstrap starting.
I20260808 05:11:55.209971 11101 raft_consensus.cc:348] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.210104 11101 raft_consensus.cc:374] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:55.210141 11101 raft_consensus.cc:729] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 546083657841475fb96becc6f6366bc9, State: Initialized, Role: FOLLOWER
I20260808 05:11:55.210259 11101 consensus_queue.cc:260] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.210433 11106 tablet_bootstrap.cc:654] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:55.210496 11101 ts_tablet_manager.cc:1428] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260808 05:11:55.210494 11100 raft_consensus.cc:348] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.210625 11079 heartbeater.cc:503] Master 127.12.251.62:36821 was elected leader, sending a full tablet report...
I20260808 05:11:55.210656 11100 raft_consensus.cc:374] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:55.210698 11100 raft_consensus.cc:729] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 42a4ef97eb08475882fcdf8d80cd6db5, State: Initialized, Role: FOLLOWER
I20260808 05:11:55.210749 11106 log.cc:824] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:55.210803 11100 consensus_queue.cc:260] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.211058 11100 ts_tablet_manager.cc:1428] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260808 05:11:55.211273 10893 heartbeater.cc:503] Master 127.12.251.62:36821 was elected leader, sending a full tablet report...
I20260808 05:11:55.211653 11106 tablet_bootstrap.cc:492] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160: No bootstrap required, opened a new log
I20260808 05:11:55.211717 11106 ts_tablet_manager.cc:1397] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260808 05:11:55.213590 11106 raft_consensus.cc:348] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.213743 11106 raft_consensus.cc:374] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:55.213791 11106 raft_consensus.cc:729] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dda3eed9da79493fb5d3b4eafe681160, State: Initialized, Role: FOLLOWER
I20260808 05:11:55.213897 11106 consensus_queue.cc:260] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.214119 11106 ts_tablet_manager.cc:1428] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260808 05:11:55.214169 10704 heartbeater.cc:503] Master 127.12.251.62:36821 was elected leader, sending a full tablet report...
I20260808 05:11:55.242077 11108 raft_consensus.cc:482] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260808 05:11:55.242182 11108 raft_consensus.cc:504] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.242563 11108 leader_election.cc:288] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers dda3eed9da79493fb5d3b4eafe681160 (127.12.251.1:33477), 546083657841475fb96becc6f6366bc9 (127.12.251.3:36877)
I20260808 05:11:55.245105 10896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.242702 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33477 (local address 127.12.251.2:57347)
0808 05:11:55.242760 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.242772 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:55.242813 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:55.242925 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:55.242926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:55.242927 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:55.242997 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.242999 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.243591 (+ 592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.243592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.244318 (+ 726us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.244319 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.244872 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.244873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.244945 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.244949 (+ 4us) client_negotiation.cc:769] Sending connection context
0808 05:11:55.244994 (+ 45us) client_negotiation.cc:240] Negotiation successful
0808 05:11:55.245036 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 05:11:55.245105 11099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.242761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:57347 (local address 127.12.251.1:33477)
0808 05:11:55.242816 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.242818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.242827 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:11:55.242855 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.242856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.242867 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.242915 (+ 48us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:55.243055 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.243523 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.244399 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.244804 (+ 405us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.244865 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.244873 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.245004 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.245037 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260808 05:11:55.245268 11097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.242825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.251.2:43795 (local address 127.12.251.3:36877)
0808 05:11:55.242867 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.242869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.242944 (+ 75us) server_negotiation.cc:407] Connection header received
0808 05:11:55.242997 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.242998 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.243006 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.243061 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0808 05:11:55.243187 (+ 126us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.243706 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.244574 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.244956 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.245015 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.245022 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.245153 (+ 131us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.245185 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:11:55.245281 11114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.242720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.3:36877 (local address 127.12.251.2:43795)
0808 05:11:55.242884 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.242892 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0808 05:11:55.242948 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:11:55.243067 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:11:55.243068 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:11:55.243069 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0808 05:11:55.243134 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.243136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.243778 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.243779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.244497 (+ 718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:11:55.244499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.245041 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.245042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:11:55.245096 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.245099 (+ 3us) client_negotiation.cc:769] Sending connection context
0808 05:11:55.245142 (+ 43us) client_negotiation.cc:240] Negotiation successful
0808 05:11:55.245177 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":100,"threads_started":1}
I20260808 05:11:55.245620 10619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5d42c5528d64b2db4b34bc3c4266973" candidate_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda3eed9da79493fb5d3b4eafe681160" is_pre_election: true
I20260808 05:11:55.245633 11010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5d42c5528d64b2db4b34bc3c4266973" candidate_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546083657841475fb96becc6f6366bc9" is_pre_election: true
I20260808 05:11:55.245769 11010 raft_consensus.cc:2454] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42a4ef97eb08475882fcdf8d80cd6db5 in term 0.
I20260808 05:11:55.245770 10619 raft_consensus.cc:2454] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 42a4ef97eb08475882fcdf8d80cd6db5 in term 0.
I20260808 05:11:55.245990 10729 leader_election.cc:302] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 42a4ef97eb08475882fcdf8d80cd6db5, 546083657841475fb96becc6f6366bc9, dda3eed9da79493fb5d3b4eafe681160; no voters:
I20260808 05:11:55.246124 11108 raft_consensus.cc:2781] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260808 05:11:55.246177 11108 raft_consensus.cc:482] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260808 05:11:55.246192 11108 raft_consensus.cc:3037] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:55.246891 11108 raft_consensus.cc:504] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.247000 11108 leader_election.cc:288] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [CANDIDATE]: Term 1 election: Requested vote from peers dda3eed9da79493fb5d3b4eafe681160 (127.12.251.1:33477), 546083657841475fb96becc6f6366bc9 (127.12.251.3:36877)
I20260808 05:11:55.247141 11010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5d42c5528d64b2db4b34bc3c4266973" candidate_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "546083657841475fb96becc6f6366bc9"
I20260808 05:11:55.247155 10619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e5d42c5528d64b2db4b34bc3c4266973" candidate_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "dda3eed9da79493fb5d3b4eafe681160"
I20260808 05:11:55.247215 10619 raft_consensus.cc:3037] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:55.247217 11010 raft_consensus.cc:3037] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:55.247898 11010 raft_consensus.cc:2454] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42a4ef97eb08475882fcdf8d80cd6db5 in term 1.
I20260808 05:11:55.247911 10619 raft_consensus.cc:2454] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 42a4ef97eb08475882fcdf8d80cd6db5 in term 1.
I20260808 05:11:55.248083 10730 leader_election.cc:302] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 42a4ef97eb08475882fcdf8d80cd6db5, dda3eed9da79493fb5d3b4eafe681160; no voters:
I20260808 05:11:55.248162 11108 raft_consensus.cc:2781] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:55.248289 11108 raft_consensus.cc:686] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 1 LEADER]: Becoming Leader. State: Replica: 42a4ef97eb08475882fcdf8d80cd6db5, State: Running, Role: LEADER
I20260808 05:11:55.248369 11108 consensus_queue.cc:237] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } }
I20260808 05:11:55.249094 10407 catalog_manager.cc:5495] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 42a4ef97eb08475882fcdf8d80cd6db5 (127.12.251.2). New cstate: current_term: 1 leader_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "42a4ef97eb08475882fcdf8d80cd6db5" member_type: VOTER last_known_addr { host: "127.12.251.2" port: 32927 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 } health_report { overall_health: UNKNOWN } } }
I20260808 05:11:55.258221 11098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.256023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57594 (local address 127.12.251.2:32927)
0808 05:11:55.256088 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:55.256090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:55.256097 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:11:55.256125 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:55.256126 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:55.256144 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:55.256205 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:11:55.256306 (+ 101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.256750 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.257533 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:55.257728 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:55.257780 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:55.257915 (+ 135us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:11:55.258009 (+ 94us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:11:55.258077 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:55.258116 (+ 39us) server_negotiation.cc:299] Negotiation successful
0808 05:11:55.258136 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260808 05:11:55.259754 10619 raft_consensus.cc:1261] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 1 FOLLOWER]: Refusing update from remote peer 42a4ef97eb08475882fcdf8d80cd6db5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:55.259794 11010 raft_consensus.cc:1261] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 1 FOLLOWER]: Refusing update from remote peer 42a4ef97eb08475882fcdf8d80cd6db5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:11:55.260041 11108 consensus_queue.cc:1035] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "dda3eed9da79493fb5d3b4eafe681160" member_type: VOTER last_known_addr { host: "127.12.251.1" port: 33477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:55.260161 11115 consensus_queue.cc:1035] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "546083657841475fb96becc6f6366bc9" member_type: VOTER last_known_addr { host: "127.12.251.3" port: 36877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:11:55.262696 11123 mvcc.cc:205] Tried to move back new op lower bound from 7316135588901761024 to 7316135588857946112. Current Snapshot: MvccSnapshot[applied={T|T < 7316135588901761024}]
I20260808 05:11:55.262913 11125 mvcc.cc:205] Tried to move back new op lower bound from 7316135588901761024 to 7316135588857946112. Current Snapshot: MvccSnapshot[applied={T|T < 7316135588901761024}]
I20260808 05:11:55.264381 10408 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:55.264495 10408 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:41582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260808 05:11:55.265182 10408 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1d253feb6e8a40c8b8beedf1b9fc4672: Sending DeleteTablet for 3 replicas of tablet e5d42c5528d64b2db4b34bc3c4266973
I20260808 05:11:55.265527 10792 tablet_service.cc:1514] Processing DeleteTablet for tablet e5d42c5528d64b2db4b34bc3c4266973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:55 UTC) from {username='slave'} at 127.0.0.1:57586
I20260808 05:11:55.265552 10983 tablet_service.cc:1514] Processing DeleteTablet for tablet e5d42c5528d64b2db4b34bc3c4266973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:55 UTC) from {username='slave'} at 127.0.0.1:53494
I20260808 05:11:55.265750 11136 tablet_replica.cc:330] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: stopping tablet replica
I20260808 05:11:55.265731 10587 tablet_service.cc:1514] Processing DeleteTablet for tablet e5d42c5528d64b2db4b34bc3c4266973 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-08 05:11:55 UTC) from {username='slave'} at 127.0.0.1:35838
I20260808 05:11:55.265841 11136 raft_consensus.cc:2229] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 1 LEADER]: Raft consensus shutting down.
I20260808 05:11:55.265916 11138 tablet_replica.cc:330] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160: stopping tablet replica
I20260808 05:11:55.265956 11136 raft_consensus.cc:2258] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:55.266016 11138 raft_consensus.cc:2229] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:55.266134 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 10509
I20260808 05:11:55.266183 11138 raft_consensus.cc:2258] T e5d42c5528d64b2db4b34bc3c4266973 P dda3eed9da79493fb5d3b4eafe681160 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:55.275242 11136 ts_tablet_manager.cc:1905] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:55.276880 11136 ts_tablet_manager.cc:1918] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:55.276948 11136 log.cc:1196] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-1/wal/wals/e5d42c5528d64b2db4b34bc3c4266973
I20260808 05:11:55.277194 11136 ts_tablet_manager.cc:1939] T e5d42c5528d64b2db4b34bc3c4266973 P 42a4ef97eb08475882fcdf8d80cd6db5: Deleting consensus metadata
I20260808 05:11:55.277673 10389 catalog_manager.cc:4841] TS 42a4ef97eb08475882fcdf8d80cd6db5 (127.12.251.2:32927): tablet e5d42c5528d64b2db4b34bc3c4266973 (table test-table [id=fb0ff444d13346c59447fbb3b4ae708b]) successfully deleted
I20260808 05:11:55.286096 11137 tablet_replica.cc:330] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: stopping tablet replica
I20260808 05:11:55.286281 11137 raft_consensus.cc:2229] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260808 05:11:55.286417 11137 raft_consensus.cc:2258] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260808 05:11:55.288014 11137 ts_tablet_manager.cc:1905] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260808 05:11:55.289685 11137 ts_tablet_manager.cc:1918] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260808 05:11:55.289788 11137 log.cc:1196] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Deleting WAL directory at /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786165676707025-13292-0/minicluster-data/ts-2/wal/wals/e5d42c5528d64b2db4b34bc3c4266973
I20260808 05:11:55.290081 11137 ts_tablet_manager.cc:1939] T e5d42c5528d64b2db4b34bc3c4266973 P 546083657841475fb96becc6f6366bc9: Deleting consensus metadata
I20260808 05:11:55.290548 10386 catalog_manager.cc:4841] TS 546083657841475fb96becc6f6366bc9 (127.12.251.3:36877): tablet e5d42c5528d64b2db4b34bc3c4266973 (table test-table [id=fb0ff444d13346c59447fbb3b4ae708b]) successfully deleted
W20260808 05:11:55.297034 10388 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.251.1:33477 (error 108)
I20260808 05:11:55.297267 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 10709
I20260808 05:11:55.310339 11095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:55.310165 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.1:33477 (local address 127.0.0.1:35852)
0808 05:11:55.310226 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0808 05:11:55.310289 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.1:33477: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260808 05:11:55.310539 10388 catalog_manager.cc:4584] TS dda3eed9da79493fb5d3b4eafe681160 (127.12.251.1:33477): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e5d42c5528d64b2db4b34bc3c4266973: Network error: Client connection negotiation failed: client connection to 127.12.251.1:33477: connect: Connection refused (error 111)
I20260808 05:11:55.314029 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 10898
I20260808 05:11:55.323264 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 10366
2026-08-08T05:11:55Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (738 ms)
[----------] 6 tests from EncryptionPolicyTest (8826 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:11:55 dist-test-slave-bndk krb5kdc[11143](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:11:55 dist-test-slave-bndk krb5kdc[11143](info): set up 2 sockets
Aug 08 05:11:55 dist-test-slave-bndk krb5kdc[11143](info): commencing operation
krb5kdc: starting...
W20260808 05:11:56.443667 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:11:56 dist-test-slave-bndk krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:11:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:11:56.559530 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43439
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36443
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43439
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:56.641433 11162 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:56.641628 11162 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:56.641649 11162 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:56.642755 11162 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:56.642795 11162 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:56.642808 11162 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:56.642829 11162 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:56.642853 11162 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:56.644416 11162 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36443
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43439
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43439
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11162
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:56.644649 11162 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:56.644858 11162 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:56.649365 11169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:56.649384 11168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:56.649358 11171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:56.649688 11162 server_base.cc:1034] running on GCE node
I20260808 05:11:56.649901 11162 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:56.650166 11162 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:56.651351 11162 hybrid_clock.cc:648] HybridClock initialized: now 1786165916651301 us; error 30 us; skew 500 ppm
Aug 08 05:11:56 dist-test-slave-bndk krb5kdc[11143](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165916, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:56.653760 11162 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:11:56.654134 11162 webserver.cc:460] Webserver started at http://127.0.0.1:44985/ using document root <none> and password file <none>
I20260808 05:11:56.654320 11162 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:56.654358 11162 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:56.654445 11162 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:56.655408 11162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "b79a1b1dbc674d01b28753849e30cdb8"
format_stamp: "Formatted at 2026-08-08 05:11:56 on dist-test-slave-bndk"
server_key: "a777d13aceca0ec7c6d587f66df600df"
server_key_iv: "5f506b744e51ecd79a5c3fb48168faf9"
server_key_version: "encryptionkey@0"
I20260808 05:11:56.655700 11162 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "b79a1b1dbc674d01b28753849e30cdb8"
format_stamp: "Formatted at 2026-08-08 05:11:56 on dist-test-slave-bndk"
server_key: "a777d13aceca0ec7c6d587f66df600df"
server_key_iv: "5f506b744e51ecd79a5c3fb48168faf9"
server_key_version: "encryptionkey@0"
I20260808 05:11:56.656867 11162 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:11:56.657516 11179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:56.657681 11162 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:56.657764 11162 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "b79a1b1dbc674d01b28753849e30cdb8"
format_stamp: "Formatted at 2026-08-08 05:11:56 on dist-test-slave-bndk"
server_key: "a777d13aceca0ec7c6d587f66df600df"
server_key_iv: "5f506b744e51ecd79a5c3fb48168faf9"
server_key_version: "encryptionkey@0"
I20260808 05:11:56.657816 11162 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:56.670552 11162 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:56.672191 11162 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:56.672297 11162 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:56.676167 11162 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43439
I20260808 05:11:56.676224 11255 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43439 every 8 connection(s)
I20260808 05:11:56.676523 11162 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:56.677392 11256 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:56.679620 11256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8: Bootstrap starting.
I20260808 05:11:56.680176 11256 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:56.680446 11256 log.cc:824] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:56.681090 11256 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8: No bootstrap required, opened a new log
I20260808 05:11:56.682677 11256 raft_consensus.cc:348] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79a1b1dbc674d01b28753849e30cdb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43439 } }
I20260808 05:11:56.682823 11256 raft_consensus.cc:374] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:56.682866 11256 raft_consensus.cc:729] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b79a1b1dbc674d01b28753849e30cdb8, State: Initialized, Role: FOLLOWER
I20260808 05:11:56.683003 11256 consensus_queue.cc:260] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79a1b1dbc674d01b28753849e30cdb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43439 } }
I20260808 05:11:56.683081 11256 raft_consensus.cc:388] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:56.683116 11256 raft_consensus.cc:482] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:56.683162 11256 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:56.683660 11256 raft_consensus.cc:504] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79a1b1dbc674d01b28753849e30cdb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43439 } }
I20260808 05:11:56.683754 11256 leader_election.cc:302] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b79a1b1dbc674d01b28753849e30cdb8; no voters:
I20260808 05:11:56.683801 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 11162
I20260808 05:11:56.683919 11256 leader_election.cc:288] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:56.683938 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:56.683940 11260 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:56.684062 11260 raft_consensus.cc:686] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [term 1 LEADER]: Becoming Leader. State: Replica: b79a1b1dbc674d01b28753849e30cdb8, State: Running, Role: LEADER
I20260808 05:11:56.684119 13292 external_mini_cluster.cc:1428] Setting key 8d5dfb10e4e024edecffaddc47dc2af5
I20260808 05:11:56.684144 11260 consensus_queue.cc:237] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79a1b1dbc674d01b28753849e30cdb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43439 } }
I20260808 05:11:56.684172 11256 sys_catalog.cc:564] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:56.684700 11262 sys_catalog.cc:455] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b79a1b1dbc674d01b28753849e30cdb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79a1b1dbc674d01b28753849e30cdb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43439 } } }
I20260808 05:11:56.684808 11262 sys_catalog.cc:458] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:56.684511 11260 sys_catalog.cc:455] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b79a1b1dbc674d01b28753849e30cdb8. Latest consensus state: current_term: 1 leader_uuid: "b79a1b1dbc674d01b28753849e30cdb8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b79a1b1dbc674d01b28753849e30cdb8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43439 } } }
I20260808 05:11:56.684995 11260 sys_catalog.cc:458] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:56.685111 11277 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:56.685640 11277 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:56.687943 11277 catalog_manager.cc:1347] Generated new cluster ID: 5b90712f5cc74737819a35b126a21f7f
I20260808 05:11:56.688030 11277 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:11:56 dist-test-slave-bndk krb5kdc[11143](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165916, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:11:56.695111 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:56.684587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53015 (local address 127.0.0.1:43439)
0808 05:11:56.684777 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:56.684787 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:56.685732 (+ 945us) server_negotiation.cc:407] Connection header received
0808 05:11:56.685970 (+ 238us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:56.685978 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:56.686034 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:56.686141 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:56.686980 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:56.688181 (+ 1201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:56.688929 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:56.689386 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:56.689491 (+ 105us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:56.691690 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:56.691694 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:56.691694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:56.691704 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:56.693659 (+ 1955us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:56.694014 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:56.694016 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:56.694017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:56.694110 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:56.694314 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:56.694314 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:56.694315 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:56.694551 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:56.694729 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:56.694824 (+ 95us) server_negotiation.cc:299] Negotiation successful
0808 05:11:56.694923 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":71,"threads_started":1}
I20260808 05:11:56.695981 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:11:56.702715 11269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:56.697207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42831 (local address 127.0.0.1:43439)
0808 05:11:56.697256 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:56.697258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:56.697359 (+ 101us) server_negotiation.cc:407] Connection header received
0808 05:11:56.697404 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:56.697405 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:56.697414 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:56.697454 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:56.697924 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:56.698409 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:56.699056 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:56.699266 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:56.699319 (+ 53us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:56.700332 (+ 1013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:56.700333 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:56.700334 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:11:56.700340 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:56.701698 (+ 1358us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:56.702020 (+ 322us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:56.702021 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:56.702021 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:56.702072 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:11:56.702257 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:11:56.702258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:11:56.702258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:11:56.702357 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:56.702441 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:56.702573 (+ 132us) server_negotiation.cc:299] Negotiation successful
0808 05:11:56.702633 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:11:56.711992 11277 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:56.712528 11277 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:56.719990 11277 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b79a1b1dbc674d01b28753849e30cdb8: Generated new TSK 0
I20260808 05:11:56.720165 11277 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:11:56.724021 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 11162
W20260808 05:11:56.733201 11141 connection.cc:535] client connection to 127.0.0.1:43439 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43439): Connection reset by peer (error 104)
2026-08-08T05:11:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1402 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:11:56 dist-test-slave-bndk krb5kdc[11305](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:11:56 dist-test-slave-bndk krb5kdc[11305](info): set up 2 sockets
Aug 08 05:11:56 dist-test-slave-bndk krb5kdc[11305](info): commencing operation
krb5kdc: starting...
W20260808 05:11:57.852418 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:11:57 dist-test-slave-bndk krb5kdc[11305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165917, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:11:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:11:57.970116 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36671
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34929
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36671
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:58.052156 11322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:58.052368 11322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:58.052390 11322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:58.053519 11322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:58.053558 11322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:58.053571 11322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:58.053582 11322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:58.053596 11322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:58.055078 11322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34929
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36671
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36671
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11322
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:58.055267 11322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:58.055454 11322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:58.060030 11331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:58.060034 11334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:58.060068 11322 server_base.cc:1034] running on GCE node
W20260808 05:11:58.060038 11332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:58.060436 11322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:58.060680 11322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:58.061808 11322 hybrid_clock.cc:648] HybridClock initialized: now 1786165918061783 us; error 42 us; skew 500 ppm
Aug 08 05:11:58 dist-test-slave-bndk krb5kdc[11305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165918, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:58.064049 11322 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:11:58.064412 11322 webserver.cc:460] Webserver started at http://127.0.0.1:38977/ using document root <none> and password file <none>
I20260808 05:11:58.064611 11322 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:58.064651 11322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:58.064740 11322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:58.065739 11322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "7f3f15c55d7648f3becb4eee1ad9b612"
format_stamp: "Formatted at 2026-08-08 05:11:58 on dist-test-slave-bndk"
server_key: "b6033692ea72e6a106950d3f9e32bf5b"
server_key_iv: "5bec82641ada325b99ff4cfd76536a03"
server_key_version: "encryptionkey@0"
I20260808 05:11:58.066023 11322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "7f3f15c55d7648f3becb4eee1ad9b612"
format_stamp: "Formatted at 2026-08-08 05:11:58 on dist-test-slave-bndk"
server_key: "b6033692ea72e6a106950d3f9e32bf5b"
server_key_iv: "5bec82641ada325b99ff4cfd76536a03"
server_key_version: "encryptionkey@0"
I20260808 05:11:58.067183 11322 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:11:58.067848 11348 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:58.067998 11322 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:11:58.068081 11322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "7f3f15c55d7648f3becb4eee1ad9b612"
format_stamp: "Formatted at 2026-08-08 05:11:58 on dist-test-slave-bndk"
server_key: "b6033692ea72e6a106950d3f9e32bf5b"
server_key_iv: "5bec82641ada325b99ff4cfd76536a03"
server_key_version: "encryptionkey@0"
I20260808 05:11:58.068140 11322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:58.087627 11322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:58.089469 11322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:58.089617 11322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:58.093371 11322 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36671
I20260808 05:11:58.093436 11429 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36671 every 8 connection(s)
I20260808 05:11:58.093739 11322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:58.094625 11431 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:58.095074 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 11322
I20260808 05:11:58.095180 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:58.095345 13292 external_mini_cluster.cc:1428] Setting key 9c291cb8c058cc8b2cbf2715b4189571
I20260808 05:11:58.097117 11431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612: Bootstrap starting.
I20260808 05:11:58.097800 11431 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:58.098124 11431 log.cc:824] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:58.098827 11431 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612: No bootstrap required, opened a new log
I20260808 05:11:58.100909 11431 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36671 } }
I20260808 05:11:58.101080 11431 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:58.101118 11431 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f3f15c55d7648f3becb4eee1ad9b612, State: Initialized, Role: FOLLOWER
I20260808 05:11:58.101280 11431 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36671 } }
I20260808 05:11:58.101352 11431 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:58.101382 11431 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:58.101431 11431 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:58.101938 11431 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36671 } }
I20260808 05:11:58.102030 11431 leader_election.cc:302] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7f3f15c55d7648f3becb4eee1ad9b612; no voters:
I20260808 05:11:58.102200 11431 leader_election.cc:288] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:58.102265 11436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:58.095821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34979 (local address 127.0.0.1:36671)
0808 05:11:58.095997 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:58.096007 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:58.097396 (+ 1389us) server_negotiation.cc:407] Connection header received
0808 05:11:58.097997 (+ 601us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:58.098006 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:58.098071 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:58.098231 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:58.098407 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:58.099396 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:58.100471 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:58.100870 (+ 399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:58.100950 (+ 80us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:58.101642 (+ 692us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:58.101646 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:58.101646 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:58.101810 (+ 164us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:58.101841 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:58.101852 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:58.101921 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:58.102027 (+ 106us) server_negotiation.cc:299] Negotiation successful
0808 05:11:58.102055 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":63,"threads_started":1}
I20260808 05:11:58.102451 11431 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:58.102237 11439 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:58.102608 11439 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [term 1 LEADER]: Becoming Leader. State: Replica: 7f3f15c55d7648f3becb4eee1ad9b612, State: Running, Role: LEADER
I20260808 05:11:58.102754 11439 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36671 } }
I20260808 05:11:58.103210 11440 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36671 } } }
I20260808 05:11:58.103222 11442 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7f3f15c55d7648f3becb4eee1ad9b612. Latest consensus state: current_term: 1 leader_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7f3f15c55d7648f3becb4eee1ad9b612" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36671 } } }
I20260808 05:11:58.103299 11440 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:58.103327 11442 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:58.103480 11452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:58.103984 11452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:58.104214 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:11:58.105437 11452 catalog_manager.cc:1347] Generated new cluster ID: 1ab2b52d79f14e1198b926aa73876f1b
I20260808 05:11:58.105492 11452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:58.112110 11436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:58.109489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50215 (local address 127.0.0.1:36671)
0808 05:11:58.109526 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:58.109527 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:58.109634 (+ 107us) server_negotiation.cc:407] Connection header received
0808 05:11:58.109686 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:58.109687 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:58.109696 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:58.109747 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:58.109880 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:58.110341 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:58.111009 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:11:58.111241 (+ 232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:11:58.111307 (+ 66us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:11:58.111891 (+ 584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:58.111892 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:58.111892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:58.111897 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:58.111910 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:58.111914 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:58.111958 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:58.112031 (+ 73us) server_negotiation.cc:299] Negotiation successful
0808 05:11:58.112040 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260808 05:11:58.115357 11452 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:58.116029 11452 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:58.133031 11452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7f3f15c55d7648f3becb4eee1ad9b612: Generated new TSK 0
I20260808 05:11:58.133272 11452 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:11:58.139098 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 11322
W20260808 05:11:58.148195 11301 connection.cc:535] client connection to 127.0.0.1:36671 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36671): Connection reset by peer (error 104)
2026-08-08T05:11:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:11:58 dist-test-slave-bndk krb5kdc[11481](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:11:58 dist-test-slave-bndk krb5kdc[11481](info): set up 2 sockets
Aug 08 05:11:58 dist-test-slave-bndk krb5kdc[11481](info): commencing operation
krb5kdc: starting...
W20260808 05:11:59.265950 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.104s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:11:59 dist-test-slave-bndk krb5kdc[11481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165919, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:11:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:11:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:11:59.381589 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39365
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39365
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:11:59.462684 11502 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:11:59.462883 11502 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:11:59.462903 11502 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:11:59.464011 11502 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:11:59.464054 11502 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:11:59.464067 11502 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:11:59.464092 11502 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:11:59.464115 11502 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:11:59.465602 11502 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39365
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39365
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11502
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:11:59.465835 11502 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:11:59.466041 11502 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:11:59.470630 11509 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:11:59.470655 11510 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:59.470705 11502 server_base.cc:1034] running on GCE node
W20260808 05:11:59.470664 11514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:11:59.471139 11502 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:11:59.471421 11502 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:11:59.472570 11502 hybrid_clock.cc:648] HybridClock initialized: now 1786165919472565 us; error 37 us; skew 500 ppm
Aug 08 05:11:59 dist-test-slave-bndk krb5kdc[11481](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165919, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:11:59.474905 11502 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:11:59.475322 11502 webserver.cc:460] Webserver started at http://127.0.0.1:41087/ using document root <none> and password file <none>
I20260808 05:11:59.475538 11502 fs_manager.cc:359] Metadata directory not provided
I20260808 05:11:59.475585 11502 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:11:59.475711 11502 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:11:59.476763 11502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "4f46d359ae6f44e8a88d08a317c70a35"
format_stamp: "Formatted at 2026-08-08 05:11:59 on dist-test-slave-bndk"
server_key: "703f64461b0de94cd55059eef0383e5f"
server_key_iv: "a461a800cd870812f87ff1ded39c8207"
server_key_version: "encryptionkey@0"
I20260808 05:11:59.477093 11502 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "4f46d359ae6f44e8a88d08a317c70a35"
format_stamp: "Formatted at 2026-08-08 05:11:59 on dist-test-slave-bndk"
server_key: "703f64461b0de94cd55059eef0383e5f"
server_key_iv: "a461a800cd870812f87ff1ded39c8207"
server_key_version: "encryptionkey@0"
I20260808 05:11:59.478355 11502 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:11:59.479013 11527 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:11:59.479161 11502 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:11:59.479244 11502 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "4f46d359ae6f44e8a88d08a317c70a35"
format_stamp: "Formatted at 2026-08-08 05:11:59 on dist-test-slave-bndk"
server_key: "703f64461b0de94cd55059eef0383e5f"
server_key_iv: "a461a800cd870812f87ff1ded39c8207"
server_key_version: "encryptionkey@0"
I20260808 05:11:59.479302 11502 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:11:59.482499 11502 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:11:59.484102 11502 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:11:59.484221 11502 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:11:59.487980 11502 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39365
I20260808 05:11:59.488011 11608 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39365 every 8 connection(s)
I20260808 05:11:59.488292 11502 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:11:59.489198 11609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:11:59.491451 11609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35: Bootstrap starting.
I20260808 05:11:59.492033 11609 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35: Neither blocks nor log segments found. Creating new log.
I20260808 05:11:59.492281 11609 log.cc:824] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35: Log is configured to *not* fsync() on all Append() calls
I20260808 05:11:59.492945 11609 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35: No bootstrap required, opened a new log
I20260808 05:11:59.494549 11609 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f46d359ae6f44e8a88d08a317c70a35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39365 } }
I20260808 05:11:59.494678 11609 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:11:59.494709 11609 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4f46d359ae6f44e8a88d08a317c70a35, State: Initialized, Role: FOLLOWER
I20260808 05:11:59.494848 11609 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f46d359ae6f44e8a88d08a317c70a35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39365 } }
I20260808 05:11:59.494910 11609 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:11:59.494932 11609 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:11:59.494977 11609 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:11:59.495460 11609 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f46d359ae6f44e8a88d08a317c70a35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39365 } }
I20260808 05:11:59.495550 11609 leader_election.cc:302] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4f46d359ae6f44e8a88d08a317c70a35; no voters:
I20260808 05:11:59.495694 11609 leader_election.cc:288] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:11:59.495733 11614 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:11:59.495882 11614 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [term 1 LEADER]: Becoming Leader. State: Replica: 4f46d359ae6f44e8a88d08a317c70a35, State: Running, Role: LEADER
I20260808 05:11:59.495925 11609 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:11:59.495985 11614 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f46d359ae6f44e8a88d08a317c70a35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39365 } }
I20260808 05:11:59.496342 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 11502
I20260808 05:11:59.496356 11615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4f46d359ae6f44e8a88d08a317c70a35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f46d359ae6f44e8a88d08a317c70a35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39365 } } }
I20260808 05:11:59.496368 11616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4f46d359ae6f44e8a88d08a317c70a35. Latest consensus state: current_term: 1 leader_uuid: "4f46d359ae6f44e8a88d08a317c70a35" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4f46d359ae6f44e8a88d08a317c70a35" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39365 } } }
I20260808 05:11:59.496438 11615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:59.496457 11616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35 [sys.catalog]: This master's current role is: LEADER
I20260808 05:11:59.496469 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:11:59.496637 11619 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:11:59.496663 13292 external_mini_cluster.cc:1428] Setting key 5a154e6c3127c366ff7a73c4da121475
I20260808 05:11:59.497447 11619 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:11:59.498937 11629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:59.497124 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52687 (local address 127.0.0.1:39365)
0808 05:11:59.497310 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:59.497320 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:59.497450 (+ 130us) server_negotiation.cc:407] Connection header received
0808 05:11:59.497573 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:59.497581 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:59.497611 (+ 30us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:59.498040 (+ 429us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:59.498503 (+ 463us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:59.498506 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:59.498506 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:59.498510 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:59.498548 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:59.498562 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:59.498630 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:59.498719 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:11:59.498762 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":69,"threads_started":1}
I20260808 05:11:59.498999 11619 catalog_manager.cc:1347] Generated new cluster ID: b9293425965e4f7f9ea64be8f922b6f6
I20260808 05:11:59.499040 11619 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:11:59.499745 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:11:59.502030 11629 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:11:59.500973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38091 (local address 127.0.0.1:39365)
0808 05:11:59.501005 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 05:11:59.501007 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:11:59.501132 (+ 125us) server_negotiation.cc:407] Connection header received
0808 05:11:59.501186 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:11:59.501187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:11:59.501192 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:11:59.501311 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:11:59.501831 (+ 520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:11:59.501833 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:11:59.501833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:11:59.501837 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:11:59.501851 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:11:59.501855 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:11:59.501902 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:11:59.501958 (+ 56us) server_negotiation.cc:299] Negotiation successful
0808 05:11:59.501971 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:11:59.508337 11619 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:11:59.508479 11619 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:11:59.530347 11619 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4f46d359ae6f44e8a88d08a317c70a35: Generated new TSK 0
I20260808 05:11:59.530584 11619 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:11:59.536087 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 11502
2026-08-08T05:11:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1396 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:11:59 dist-test-slave-bndk krb5kdc[11661](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:11:59 dist-test-slave-bndk krb5kdc[11661](info): set up 2 sockets
Aug 08 05:11:59 dist-test-slave-bndk krb5kdc[11661](info): commencing operation
krb5kdc: starting...
W20260808 05:12:00.672243 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.114s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:00 dist-test-slave-bndk krb5kdc[11661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:00.785895 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37571
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44795
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37571
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:00.866215 11686 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:00.866413 11686 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:00.866443 11686 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:00.867542 11686 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:00.867581 11686 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:00.867599 11686 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:00.867615 11686 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:00.867630 11686 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:00.869066 11686 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44795
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37571
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37571
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11686
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:00.869328 11686 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:00.869527 11686 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:00.873992 11699 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:00.874004 11696 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:00.874020 11701 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:00.874280 11686 server_base.cc:1034] running on GCE node
I20260808 05:12:00.874497 11686 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:00.874750 11686 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:00.875878 11686 hybrid_clock.cc:648] HybridClock initialized: now 1786165920875867 us; error 29 us; skew 500 ppm
Aug 08 05:12:00 dist-test-slave-bndk krb5kdc[11661](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165920, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:00.878234 11686 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:00.878661 11686 webserver.cc:460] Webserver started at http://127.0.0.1:37339/ using document root <none> and password file <none>
I20260808 05:12:00.878865 11686 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:00.878921 11686 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:00.879058 11686 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:00.880031 11686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "e8ad072fad724d318d0d80ba98d77191"
format_stamp: "Formatted at 2026-08-08 05:12:00 on dist-test-slave-bndk"
server_key: "6260fc811db4f1bf27ed0d69a031fb47"
server_key_iv: "fdff4535323eb4c1dafe54c5f0494d08"
server_key_version: "encryptionkey@0"
I20260808 05:12:00.880348 11686 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "e8ad072fad724d318d0d80ba98d77191"
format_stamp: "Formatted at 2026-08-08 05:12:00 on dist-test-slave-bndk"
server_key: "6260fc811db4f1bf27ed0d69a031fb47"
server_key_iv: "fdff4535323eb4c1dafe54c5f0494d08"
server_key_version: "encryptionkey@0"
I20260808 05:12:00.881593 11686 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:00.882237 11709 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:00.882370 11686 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:00.882462 11686 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "e8ad072fad724d318d0d80ba98d77191"
format_stamp: "Formatted at 2026-08-08 05:12:00 on dist-test-slave-bndk"
server_key: "6260fc811db4f1bf27ed0d69a031fb47"
server_key_iv: "fdff4535323eb4c1dafe54c5f0494d08"
server_key_version: "encryptionkey@0"
I20260808 05:12:00.882615 11686 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:00.894697 11686 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:00.896365 11686 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:00.896492 11686 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:00.900316 11686 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37571
I20260808 05:12:00.900362 11792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37571 every 8 connection(s)
I20260808 05:12:00.900679 11686 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:00.901516 11793 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:00.903712 11793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191: Bootstrap starting.
I20260808 05:12:00.904219 11793 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:00.904462 11793 log.cc:824] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:00.905066 11793 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191: No bootstrap required, opened a new log
I20260808 05:12:00.906658 11793 raft_consensus.cc:348] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ad072fad724d318d0d80ba98d77191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37571 } }
I20260808 05:12:00.906791 11793 raft_consensus.cc:374] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:00.906812 11793 raft_consensus.cc:729] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8ad072fad724d318d0d80ba98d77191, State: Initialized, Role: FOLLOWER
I20260808 05:12:00.906944 11793 consensus_queue.cc:260] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ad072fad724d318d0d80ba98d77191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37571 } }
I20260808 05:12:00.907027 11793 raft_consensus.cc:388] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:00.907058 11793 raft_consensus.cc:482] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:00.907106 11793 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:00.907686 11793 raft_consensus.cc:504] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ad072fad724d318d0d80ba98d77191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37571 } }
I20260808 05:12:00.907774 11793 leader_election.cc:302] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e8ad072fad724d318d0d80ba98d77191; no voters:
I20260808 05:12:00.907891 11793 leader_election.cc:288] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:00.907943 11798 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:00.908107 11793 sys_catalog.cc:564] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:00.908123 11798 raft_consensus.cc:686] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [term 1 LEADER]: Becoming Leader. State: Replica: e8ad072fad724d318d0d80ba98d77191, State: Running, Role: LEADER
I20260808 05:12:00.908274 11798 consensus_queue.cc:237] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ad072fad724d318d0d80ba98d77191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37571 } }
I20260808 05:12:00.908661 11800 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e8ad072fad724d318d0d80ba98d77191. Latest consensus state: current_term: 1 leader_uuid: "e8ad072fad724d318d0d80ba98d77191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ad072fad724d318d0d80ba98d77191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37571 } } }
I20260808 05:12:00.908690 11799 sys_catalog.cc:455] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e8ad072fad724d318d0d80ba98d77191" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e8ad072fad724d318d0d80ba98d77191" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37571 } } }
I20260808 05:12:00.908829 11799 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:00.909060 11802 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:00.909042 11800 sys_catalog.cc:458] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:00.909670 11802 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:00.910091 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 11686
I20260808 05:12:00.910190 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:00.910369 13292 external_mini_cluster.cc:1428] Setting key 484ad6ab379edb950dc727438a1bd16d
I20260808 05:12:00.911962 11802 catalog_manager.cc:1347] Generated new cluster ID: d9b4a0711e13470aa56fd0d4b080a795
I20260808 05:12:00.912016 11802 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:12:00 dist-test-slave-bndk krb5kdc[11661](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165920, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:12:00.919426 11820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:00.910917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58873 (local address 127.0.0.1:37571)
0808 05:12:00.911087 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:00.911096 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:00.911127 (+ 31us) server_negotiation.cc:407] Connection header received
0808 05:12:00.911238 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:00.911246 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:00.911315 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:00.911480 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:00.912165 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:00.913117 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:00.913859 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:00.914288 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:00.914383 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:00.916507 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:00.916511 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:00.916512 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:00.916523 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:00.918019 (+ 1496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:00.918334 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:00.918337 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:00.918338 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:00.918432 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:00.918607 (+ 175us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:00.918607 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:00.918608 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:00.918851 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:00.919006 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:00.919097 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 05:12:00.919230 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":115,"thread_start_us":76,"threads_started":1}
I20260808 05:12:00.920298 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:00.930797 11820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:00.925447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42741 (local address 127.0.0.1:37571)
0808 05:12:00.925484 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:00.925486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:00.925611 (+ 125us) server_negotiation.cc:407] Connection header received
0808 05:12:00.925661 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:00.925662 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:00.925689 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:00.925736 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:00.926222 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:00.926713 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:00.927360 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:00.927583 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:00.927638 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:00.928626 (+ 988us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:00.928627 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:00.928627 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:00.928634 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:00.929836 (+ 1202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:00.930138 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:00.930139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:00.930140 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:00.930190 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:00.930357 (+ 167us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:00.930358 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:00.930358 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:00.930465 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:00.930545 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:00.930645 (+ 100us) server_negotiation.cc:299] Negotiation successful
0808 05:12:00.930716 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:12:00.953608 11802 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:00.954348 11802 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:00.960943 11802 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e8ad072fad724d318d0d80ba98d77191: Generated new TSK 0
I20260808 05:12:00.961129 11802 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:00.964926 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 11686
2026-08-08T05:12:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1431 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:01 dist-test-slave-bndk krb5kdc[11831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:01 dist-test-slave-bndk krb5kdc[11831](info): set up 2 sockets
Aug 08 05:12:01 dist-test-slave-bndk krb5kdc[11831](info): commencing operation
krb5kdc: starting...
W20260808 05:12:02.095675 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.107s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:02 dist-test-slave-bndk krb5kdc[11831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165922, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:02.212150 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46211
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46775
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46211
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:02.292608 11859 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:02.292805 11859 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:02.292826 11859 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:02.293923 11859 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:02.293956 11859 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:02.293969 11859 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:02.293980 11859 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:02.293991 11859 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:02.295405 11859 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46775
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46211
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11859
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:02.295594 11859 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:02.295760 11859 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:02.300453 11865 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:02.300495 11870 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:02.300478 11867 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:02.300541 11859 server_base.cc:1034] running on GCE node
I20260808 05:12:02.300926 11859 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:02.301204 11859 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:02.302363 11859 hybrid_clock.cc:648] HybridClock initialized: now 1786165922302357 us; error 29 us; skew 500 ppm
Aug 08 05:12:02 dist-test-slave-bndk krb5kdc[11831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165922, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:02.309720 11859 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:02.310168 11859 webserver.cc:460] Webserver started at http://127.0.0.1:42345/ using document root <none> and password file <none>
I20260808 05:12:02.310385 11859 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:02.310436 11859 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:02.310567 11859 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:02.311697 11859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "f53507e011e544cb9f7e471443942ac3"
format_stamp: "Formatted at 2026-08-08 05:12:02 on dist-test-slave-bndk"
server_key: "3b16c5674b0d629119d89b862db44f3a"
server_key_iv: "bf4dc23a9a06e68825307c3fb73245b1"
server_key_version: "encryptionkey@0"
I20260808 05:12:02.312031 11859 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "f53507e011e544cb9f7e471443942ac3"
format_stamp: "Formatted at 2026-08-08 05:12:02 on dist-test-slave-bndk"
server_key: "3b16c5674b0d629119d89b862db44f3a"
server_key_iv: "bf4dc23a9a06e68825307c3fb73245b1"
server_key_version: "encryptionkey@0"
I20260808 05:12:02.313292 11859 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260808 05:12:02.314013 11884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:02.314162 11859 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:02.314248 11859 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "f53507e011e544cb9f7e471443942ac3"
format_stamp: "Formatted at 2026-08-08 05:12:02 on dist-test-slave-bndk"
server_key: "3b16c5674b0d629119d89b862db44f3a"
server_key_iv: "bf4dc23a9a06e68825307c3fb73245b1"
server_key_version: "encryptionkey@0"
I20260808 05:12:02.314312 11859 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:02.344978 11859 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:02.346815 11859 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:02.346951 11859 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:02.350842 11859 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46211
I20260808 05:12:02.350896 11961 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46211 every 8 connection(s)
I20260808 05:12:02.351213 11859 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:02.352129 11962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:02.354487 11962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3: Bootstrap starting.
I20260808 05:12:02.355005 11962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:02.355264 11962 log.cc:824] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:02.355919 11962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3: No bootstrap required, opened a new log
I20260808 05:12:02.357131 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 11859
I20260808 05:12:02.357286 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:02.357476 13292 external_mini_cluster.cc:1428] Setting key 113cef4d612748bb33f2b1ac079e6510
I20260808 05:12:02.357779 11962 raft_consensus.cc:348] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53507e011e544cb9f7e471443942ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260808 05:12:02.357991 11962 raft_consensus.cc:374] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:02.358047 11962 raft_consensus.cc:729] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f53507e011e544cb9f7e471443942ac3, State: Initialized, Role: FOLLOWER
I20260808 05:12:02.358211 11962 consensus_queue.cc:260] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53507e011e544cb9f7e471443942ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260808 05:12:02.358299 11962 raft_consensus.cc:388] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:02.358330 11962 raft_consensus.cc:482] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:02.358379 11962 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:02.359280 11962 raft_consensus.cc:504] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53507e011e544cb9f7e471443942ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260808 05:12:02.359380 11962 leader_election.cc:302] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f53507e011e544cb9f7e471443942ac3; no voters:
I20260808 05:12:02.359541 11962 leader_election.cc:288] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:02.359587 11967 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:02.359786 11962 sys_catalog.cc:564] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:02.359795 11967 raft_consensus.cc:686] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [term 1 LEADER]: Becoming Leader. State: Replica: f53507e011e544cb9f7e471443942ac3, State: Running, Role: LEADER
I20260808 05:12:02.360011 11967 consensus_queue.cc:237] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53507e011e544cb9f7e471443942ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } }
I20260808 05:12:02.360380 11968 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f53507e011e544cb9f7e471443942ac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53507e011e544cb9f7e471443942ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } } }
I20260808 05:12:02.360455 11968 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:02.360651 11969 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53507e011e544cb9f7e471443942ac3. Latest consensus state: current_term: 1 leader_uuid: "f53507e011e544cb9f7e471443942ac3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53507e011e544cb9f7e471443942ac3" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46211 } } }
I20260808 05:12:02.360970 11969 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:02.361140 11979 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:02.361850 11979 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:02.362884 11966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:02.357987 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38165 (local address 127.0.0.1:46211)
0808 05:12:02.358177 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:02.358185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:02.358217 (+ 32us) server_negotiation.cc:407] Connection header received
0808 05:12:02.358320 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:02.358327 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:02.358384 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:02.358517 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:02.358702 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:02.359644 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:02.360786 (+ 1142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:02.361453 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:02.361555 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:02.362153 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:02.362157 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:02.362158 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:02.362358 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:02.362398 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:02.362416 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:02.362489 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:02.362582 (+ 93us) server_negotiation.cc:299] Negotiation successful
0808 05:12:02.362648 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":77,"threads_started":1}
I20260808 05:12:02.363546 11979 catalog_manager.cc:1347] Generated new cluster ID: fca2a3dce4394073bda8a392380c5c0d
I20260808 05:12:02.363597 11979 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:02.363749 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:02.368508 11966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:02.365200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40553 (local address 127.0.0.1:46211)
0808 05:12:02.365251 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:02.365253 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:02.365442 (+ 189us) server_negotiation.cc:407] Connection header received
0808 05:12:02.365511 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:02.365512 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:02.365521 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:02.365566 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:02.365694 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:02.366354 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:02.367344 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:02.367648 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:02.367700 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:02.368297 (+ 597us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:02.368298 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:02.368298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:02.368302 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:02.368315 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:02.368319 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:02.368363 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:02.368409 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:12:02.368431 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:12:02.371639 11979 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:02.372116 11979 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:02.376833 11979 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f53507e011e544cb9f7e471443942ac3: Generated new TSK 0
I20260808 05:12:02.376973 11979 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:02.380769 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 11859
2026-08-08T05:12:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1417 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:02 dist-test-slave-bndk krb5kdc[12002](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:02 dist-test-slave-bndk krb5kdc[12002](info): set up 2 sockets
Aug 08 05:12:02 dist-test-slave-bndk krb5kdc[12002](info): commencing operation
krb5kdc: starting...
W20260808 05:12:03.496729 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:03 dist-test-slave-bndk krb5kdc[12002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165923, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:03.615659 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43293
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43293
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:03.700508 12024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:03.700708 12024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:03.700742 12024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:03.701920 12024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:03.701963 12024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:03.701982 12024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:03.701999 12024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:03.702024 12024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:03.703501 12024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43293
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43293
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:03.703727 12024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:03.703930 12024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:03.708673 12038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:03.708782 12024 server_base.cc:1034] running on GCE node
W20260808 05:12:03.708665 12040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:03.708668 12034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:03.709075 12024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:03.709405 12024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:03.710563 12024 hybrid_clock.cc:648] HybridClock initialized: now 1786165923710546 us; error 27 us; skew 500 ppm
Aug 08 05:12:03 dist-test-slave-bndk krb5kdc[12002](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165923, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:03.712946 12024 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:03.713395 12024 webserver.cc:460] Webserver started at http://127.0.0.1:43081/ using document root <none> and password file <none>
I20260808 05:12:03.713608 12024 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:03.713649 12024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:03.713742 12024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:03.714778 12024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "1dc5905825fa48489390ca9518c96bc4"
format_stamp: "Formatted at 2026-08-08 05:12:03 on dist-test-slave-bndk"
server_key: "ceb5b752b558b09c4bb2d93791fa6f85"
server_key_iv: "1f31b4d4cbf7f763b84bb95fd7c5837d"
server_key_version: "encryptionkey@0"
I20260808 05:12:03.715080 12024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "1dc5905825fa48489390ca9518c96bc4"
format_stamp: "Formatted at 2026-08-08 05:12:03 on dist-test-slave-bndk"
server_key: "ceb5b752b558b09c4bb2d93791fa6f85"
server_key_iv: "1f31b4d4cbf7f763b84bb95fd7c5837d"
server_key_version: "encryptionkey@0"
I20260808 05:12:03.716274 12024 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:03.716905 12050 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:03.717114 12024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:03.717207 12024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "1dc5905825fa48489390ca9518c96bc4"
format_stamp: "Formatted at 2026-08-08 05:12:03 on dist-test-slave-bndk"
server_key: "ceb5b752b558b09c4bb2d93791fa6f85"
server_key_iv: "1f31b4d4cbf7f763b84bb95fd7c5837d"
server_key_version: "encryptionkey@0"
I20260808 05:12:03.717300 12024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:03.720444 12024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:03.722497 12024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:03.722631 12024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:03.726357 12024 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43293
I20260808 05:12:03.726387 12140 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43293 every 8 connection(s)
I20260808 05:12:03.726686 12024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:03.727638 12142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:03.729918 12142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4: Bootstrap starting.
I20260808 05:12:03.730443 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 12024
I20260808 05:12:03.730489 12142 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:03.730549 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:03.730718 13292 external_mini_cluster.cc:1428] Setting key e49f9d789f729ab66198f31dbbd045af
I20260808 05:12:03.730765 12142 log.cc:824] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:03.731539 12142 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4: No bootstrap required, opened a new log
I20260808 05:12:03.732944 12147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:03.731152 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43471 (local address 127.0.0.1:43293)
0808 05:12:03.731319 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:03.731328 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:03.731357 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:12:03.731801 (+ 444us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:03.731807 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:03.731832 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:03.731953 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:03.732537 (+ 584us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:03.732540 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:03.732540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:03.732544 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:03.732580 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:03.732590 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:03.732661 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:03.732722 (+ 61us) server_negotiation.cc:299] Negotiation successful
0808 05:12:03.732752 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
I20260808 05:12:03.733882 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:03.733932 12142 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dc5905825fa48489390ca9518c96bc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43293 } }
I20260808 05:12:03.734090 12142 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:03.734125 12142 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1dc5905825fa48489390ca9518c96bc4, State: Initialized, Role: FOLLOWER
I20260808 05:12:03.734232 12142 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dc5905825fa48489390ca9518c96bc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43293 } }
I20260808 05:12:03.734308 12142 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:03.734345 12142 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:03.734392 12142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:03.735071 12142 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dc5905825fa48489390ca9518c96bc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43293 } }
I20260808 05:12:03.735185 12142 leader_election.cc:302] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1dc5905825fa48489390ca9518c96bc4; no voters:
I20260808 05:12:03.735328 12142 leader_election.cc:288] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:03.735365 12155 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:03.735558 12155 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [term 1 LEADER]: Becoming Leader. State: Replica: 1dc5905825fa48489390ca9518c96bc4, State: Running, Role: LEADER
I20260808 05:12:03.735636 12142 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:03.735695 12155 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dc5905825fa48489390ca9518c96bc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43293 } }
I20260808 05:12:03.736085 12158 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1dc5905825fa48489390ca9518c96bc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dc5905825fa48489390ca9518c96bc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43293 } } }
I20260808 05:12:03.736264 12158 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:03.736487 12147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:03.735524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60131 (local address 127.0.0.1:43293)
0808 05:12:03.735560 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:03.735562 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:03.735589 (+ 27us) server_negotiation.cc:407] Connection header received
0808 05:12:03.735660 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:03.735661 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:03.735667 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:03.735695 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:03.736290 (+ 595us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:03.736292 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:03.736292 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:03.736296 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:03.736309 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:03.736312 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:03.736355 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:03.736424 (+ 69us) server_negotiation.cc:299] Negotiation successful
0808 05:12:03.736437 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:12:03.736994 12159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1dc5905825fa48489390ca9518c96bc4. Latest consensus state: current_term: 1 leader_uuid: "1dc5905825fa48489390ca9518c96bc4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1dc5905825fa48489390ca9518c96bc4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43293 } } }
I20260808 05:12:03.737069 12159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:03.737200 12168 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:03.737680 12168 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:03.739106 12168 catalog_manager.cc:1347] Generated new cluster ID: ef79539d31d444a48b31df292199742b
I20260808 05:12:03.739149 12168 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:03.763679 12168 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:03.763854 12168 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:03.766649 12168 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1dc5905825fa48489390ca9518c96bc4: Generated new TSK 0
I20260808 05:12:03.766839 12168 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:03.777565 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 12024
2026-08-08T05:12:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1401 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:03 dist-test-slave-bndk krb5kdc[12183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:03 dist-test-slave-bndk krb5kdc[12183](info): set up 2 sockets
Aug 08 05:12:03 dist-test-slave-bndk krb5kdc[12183](info): commencing operation
krb5kdc: starting...
W20260808 05:12:04.904466 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:04 dist-test-slave-bndk krb5kdc[12183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:05.021862 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45717
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40693
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45717
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:05.102814 12203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:05.103004 12203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:05.103025 12203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:05.104092 12203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:05.104125 12203 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:05.104137 12203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:05.104152 12203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:05.104162 12203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:05.105595 12203 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40693
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45717
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12203
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:05.105803 12203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:05.105997 12203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:05.110855 12217 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:05.110865 12213 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:05.111464 12214 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:05.112056 12203 server_base.cc:1034] running on GCE node
I20260808 05:12:05.112308 12203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:05.112578 12203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:05.113722 12203 hybrid_clock.cc:648] HybridClock initialized: now 1786165925113702 us; error 33 us; skew 500 ppm
Aug 08 05:12:05 dist-test-slave-bndk krb5kdc[12183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165925, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:05.116115 12203 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:05.116587 12203 webserver.cc:460] Webserver started at http://127.0.0.1:40215/ using document root <none> and password file <none>
I20260808 05:12:05.116842 12203 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:05.116892 12203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:05.117012 12203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:05.118114 12203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "bef0a616eb1b4c3dacb73353844965b6"
format_stamp: "Formatted at 2026-08-08 05:12:05 on dist-test-slave-bndk"
server_key: "1d88e970943cb00286b54dbe61deec07"
server_key_iv: "e33dacf7764428accf23404720f79839"
server_key_version: "encryptionkey@0"
I20260808 05:12:05.118450 12203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "bef0a616eb1b4c3dacb73353844965b6"
format_stamp: "Formatted at 2026-08-08 05:12:05 on dist-test-slave-bndk"
server_key: "1d88e970943cb00286b54dbe61deec07"
server_key_iv: "e33dacf7764428accf23404720f79839"
server_key_version: "encryptionkey@0"
I20260808 05:12:05.119855 12203 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260808 05:12:05.120590 12225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:05.120759 12203 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:12:05.120849 12203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "bef0a616eb1b4c3dacb73353844965b6"
format_stamp: "Formatted at 2026-08-08 05:12:05 on dist-test-slave-bndk"
server_key: "1d88e970943cb00286b54dbe61deec07"
server_key_iv: "e33dacf7764428accf23404720f79839"
server_key_version: "encryptionkey@0"
I20260808 05:12:05.120922 12203 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:05.137686 12203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:05.139729 12203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:05.139860 12203 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:05.143812 12203 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45717
I20260808 05:12:05.143843 12307 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45717 every 8 connection(s)
I20260808 05:12:05.144151 12203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:05.144972 12308 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:05.146467 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 12203
I20260808 05:12:05.146591 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:05.146776 13292 external_mini_cluster.cc:1428] Setting key 37a2c35abe169a28ac9f67944bf4c62d
I20260808 05:12:05.147658 12308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6: Bootstrap starting.
I20260808 05:12:05.148242 12308 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:05.148573 12308 log.cc:824] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:05.149295 12308 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6: No bootstrap required, opened a new log
I20260808 05:12:05.151381 12308 raft_consensus.cc:348] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0a616eb1b4c3dacb73353844965b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260808 05:12:05.151541 12308 raft_consensus.cc:374] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:05.151580 12308 raft_consensus.cc:729] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bef0a616eb1b4c3dacb73353844965b6, State: Initialized, Role: FOLLOWER
I20260808 05:12:05.151711 12308 consensus_queue.cc:260] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0a616eb1b4c3dacb73353844965b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260808 05:12:05.151788 12308 raft_consensus.cc:388] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:05.151819 12308 raft_consensus.cc:482] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:05.151903 12308 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:05.152576 12308 raft_consensus.cc:504] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0a616eb1b4c3dacb73353844965b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260808 05:12:05.152690 12308 leader_election.cc:302] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bef0a616eb1b4c3dacb73353844965b6; no voters:
I20260808 05:12:05.152854 12308 leader_election.cc:288] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:05.152879 12318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:05.153066 12318 raft_consensus.cc:686] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [term 1 LEADER]: Becoming Leader. State: Replica: bef0a616eb1b4c3dacb73353844965b6, State: Running, Role: LEADER
I20260808 05:12:05.153122 12308 sys_catalog.cc:564] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:05.153164 12318 consensus_queue.cc:237] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0a616eb1b4c3dacb73353844965b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } }
I20260808 05:12:05.153527 12318 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bef0a616eb1b4c3dacb73353844965b6. Latest consensus state: current_term: 1 leader_uuid: "bef0a616eb1b4c3dacb73353844965b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0a616eb1b4c3dacb73353844965b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } } }
Aug 08 05:12:05 dist-test-slave-bndk krb5kdc[12183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165924, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:12:05.153733 12318 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:05.153671 12321 sys_catalog.cc:455] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bef0a616eb1b4c3dacb73353844965b6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bef0a616eb1b4c3dacb73353844965b6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45717 } } }
I20260808 05:12:05.153913 12321 sys_catalog.cc:458] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:05.154379 12332 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:05.154860 12332 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:05.156340 12332 catalog_manager.cc:1347] Generated new cluster ID: 7e701ddb145043b38cb4eeff0abc1b52
I20260808 05:12:05.156394 12332 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:05.157604 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:05.147396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:58025 (local address 127.0.0.1:45717)
0808 05:12:05.147559 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:05.147569 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:05.147597 (+ 28us) server_negotiation.cc:407] Connection header received
0808 05:12:05.148024 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:05.148031 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:05.148081 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:05.148191 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:05.148951 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:05.149978 (+ 1027us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:05.151014 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:05.151396 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:05.151465 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:05.154256 (+ 2791us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:05.154260 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:05.154261 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:05.154274 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:05.156060 (+ 1786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:05.156491 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:05.156494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:05.156494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:05.156578 (+ 84us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:05.156784 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:05.156785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:05.156785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:05.157019 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:05.157152 (+ 133us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:05.157297 (+ 145us) server_negotiation.cc:299] Negotiation successful
0808 05:12:05.157396 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":69,"threads_started":1}
I20260808 05:12:05.158481 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:05.170632 12315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:05.161530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:59331 (local address 127.0.0.1:45717)
0808 05:12:05.161568 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:05.161570 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:05.165350 (+ 3780us) server_negotiation.cc:407] Connection header received
0808 05:12:05.165407 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:05.165408 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:05.165417 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:05.165462 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:05.165940 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:05.166419 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:05.167073 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:05.167291 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:05.167345 (+ 54us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:05.168385 (+ 1040us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:05.168386 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:05.168386 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:05.168393 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:05.169617 (+ 1224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:05.169941 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:05.169942 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:05.169942 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:05.169994 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:05.170186 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:05.170187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:05.170187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:05.170287 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:05.170375 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:05.170489 (+ 114us) server_negotiation.cc:299] Negotiation successful
0808 05:12:05.170546 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:12:05.174170 12332 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:05.174631 12332 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:05.178244 12332 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bef0a616eb1b4c3dacb73353844965b6: Generated new TSK 0
I20260808 05:12:05.178399 12332 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:05.181723 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 12203
W20260808 05:12:05.194485 12181 connection.cc:535] client connection to 127.0.0.1:45717 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45717): Connection reset by peer (error 104)
2026-08-08T05:12:05Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1400 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:05 dist-test-slave-bndk krb5kdc[12358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:05 dist-test-slave-bndk krb5kdc[12358](info): set up 2 sockets
Aug 08 05:12:05 dist-test-slave-bndk krb5kdc[12358](info): commencing operation
krb5kdc: starting...
W20260808 05:12:06.307304 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:06 dist-test-slave-bndk krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165926, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:06.421981 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42817
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39919
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:06.503228 12375 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:06.503445 12375 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:06.503477 12375 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:06.504590 12375 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:06.504631 12375 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:06.504649 12375 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:06.504665 12375 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:06.504680 12375 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:06.506165 12375 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39919
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42817
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12375
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:06.506407 12375 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:06.506614 12375 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:06.511243 12380 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:06.511343 12384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:06.511260 12382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:06.511309 12375 server_base.cc:1034] running on GCE node
I20260808 05:12:06.511669 12375 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:06.511943 12375 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:06.513111 12375 hybrid_clock.cc:648] HybridClock initialized: now 1786165926513094 us; error 29 us; skew 500 ppm
Aug 08 05:12:06 dist-test-slave-bndk krb5kdc[12358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165926, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:06.515618 12375 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:06.516062 12375 webserver.cc:460] Webserver started at http://127.0.0.1:46745/ using document root <none> and password file <none>
I20260808 05:12:06.516248 12375 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:06.516287 12375 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:06.516387 12375 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:06.517434 12375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "aaaf23702cd142a888e8d7c850e62861"
format_stamp: "Formatted at 2026-08-08 05:12:06 on dist-test-slave-bndk"
server_key: "63e9b8118374d4bbf6c4350ea61ce8ec"
server_key_iv: "0a1501f96d15b066537b177831983d7d"
server_key_version: "encryptionkey@0"
I20260808 05:12:06.517732 12375 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "aaaf23702cd142a888e8d7c850e62861"
format_stamp: "Formatted at 2026-08-08 05:12:06 on dist-test-slave-bndk"
server_key: "63e9b8118374d4bbf6c4350ea61ce8ec"
server_key_iv: "0a1501f96d15b066537b177831983d7d"
server_key_version: "encryptionkey@0"
I20260808 05:12:06.518921 12375 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:12:06.519619 12395 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:06.519814 12375 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:06.519910 12375 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "aaaf23702cd142a888e8d7c850e62861"
format_stamp: "Formatted at 2026-08-08 05:12:06 on dist-test-slave-bndk"
server_key: "63e9b8118374d4bbf6c4350ea61ce8ec"
server_key_iv: "0a1501f96d15b066537b177831983d7d"
server_key_version: "encryptionkey@0"
I20260808 05:12:06.519973 12375 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:06.552906 12375 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:06.554688 12375 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:06.554813 12375 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:06.558738 12375 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42817
I20260808 05:12:06.558797 12478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42817 every 8 connection(s)
I20260808 05:12:06.559134 12375 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:06.559991 12480 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:06.562294 12480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861: Bootstrap starting.
I20260808 05:12:06.562827 12480 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:06.563063 12480 log.cc:824] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:06.563709 12480 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861: No bootstrap required, opened a new log
I20260808 05:12:06.565254 12480 raft_consensus.cc:348] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaaf23702cd142a888e8d7c850e62861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260808 05:12:06.565407 12480 raft_consensus.cc:374] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:06.565436 12480 raft_consensus.cc:729] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aaaf23702cd142a888e8d7c850e62861, State: Initialized, Role: FOLLOWER
I20260808 05:12:06.565550 12480 consensus_queue.cc:260] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaaf23702cd142a888e8d7c850e62861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260808 05:12:06.565599 12480 raft_consensus.cc:388] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:06.565623 12480 raft_consensus.cc:482] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:06.565654 12480 raft_consensus.cc:3037] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:06.566102 12480 raft_consensus.cc:504] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaaf23702cd142a888e8d7c850e62861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260808 05:12:06.566187 12480 leader_election.cc:302] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: aaaf23702cd142a888e8d7c850e62861; no voters:
I20260808 05:12:06.566303 12480 leader_election.cc:288] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:06.566355 12487 raft_consensus.cc:2781] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:06.566525 12480 sys_catalog.cc:564] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:06.566540 12487 raft_consensus.cc:686] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [term 1 LEADER]: Becoming Leader. State: Replica: aaaf23702cd142a888e8d7c850e62861, State: Running, Role: LEADER
I20260808 05:12:06.566684 12487 consensus_queue.cc:237] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaaf23702cd142a888e8d7c850e62861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } }
I20260808 05:12:06.566969 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 12375
I20260808 05:12:06.567022 12491 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader aaaf23702cd142a888e8d7c850e62861. Latest consensus state: current_term: 1 leader_uuid: "aaaf23702cd142a888e8d7c850e62861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaaf23702cd142a888e8d7c850e62861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } } }
I20260808 05:12:06.567087 12491 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:06.567101 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:06.567220 12490 sys_catalog.cc:455] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "aaaf23702cd142a888e8d7c850e62861" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "aaaf23702cd142a888e8d7c850e62861" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42817 } } }
I20260808 05:12:06.567265 12490 sys_catalog.cc:458] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:06.567299 13292 external_mini_cluster.cc:1428] Setting key 49c3923ba95efe91dcee1f248c36c2c6
I20260808 05:12:06.567631 12496 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:06.568277 12496 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:06.569926 12496 catalog_manager.cc:1347] Generated new cluster ID: 0be924ab4a184e298316cc237f4a50f1
I20260808 05:12:06.569978 12496 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:06.573408 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:06.567883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:55349 (local address 127.0.0.1:42817)
0808 05:12:06.568083 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:06.568093 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:06.568130 (+ 37us) server_negotiation.cc:407] Connection header received
0808 05:12:06.568255 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:06.568262 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:06.568323 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:06.568547 (+ 224us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:06.568759 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:06.570150 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:06.571305 (+ 1155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:06.571913 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:06.572033 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:06.572702 (+ 669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:06.572706 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:06.572707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:06.572917 (+ 210us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:06.572957 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:06.572972 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:06.573061 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:06.573139 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 05:12:06.573169 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":80,"threads_started":1}
I20260808 05:12:06.574306 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:06.577463 12496 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:06.578153 12496 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:06.579252 12511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:06.575702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:41879 (local address 127.0.0.1:42817)
0808 05:12:06.575735 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:06.575737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:06.575810 (+ 73us) server_negotiation.cc:407] Connection header received
0808 05:12:06.575864 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:06.575865 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:06.575873 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:06.575931 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:06.576031 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:06.576838 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:06.577914 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:06.578233 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:06.578302 (+ 69us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:06.579016 (+ 714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:06.579017 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:06.579018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:06.579022 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:06.579036 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:06.579041 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:06.579103 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:06.579162 (+ 59us) server_negotiation.cc:299] Negotiation successful
0808 05:12:06.579174 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:12:06.586205 12496 catalog_manager.cc:5868] T 00000000000000000000000000000000 P aaaf23702cd142a888e8d7c850e62861: Generated new TSK 0
I20260808 05:12:06.586385 12496 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:06.592226 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 12375
W20260808 05:12:06.608631 12354 connection.cc:535] client connection to 127.0.0.1:42817 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42817): Connection reset by peer (error 104)
2026-08-08T05:12:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:06 dist-test-slave-bndk krb5kdc[12539](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:06 dist-test-slave-bndk krb5kdc[12539](info): set up 2 sockets
Aug 08 05:12:06 dist-test-slave-bndk krb5kdc[12539](info): commencing operation
krb5kdc: starting...
W20260808 05:12:07.727728 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.106s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:07 dist-test-slave-bndk krb5kdc[12539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165927, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:07.847927 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39699
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35829
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39699
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:07.929428 12558 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:07.929627 12558 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:07.929648 12558 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:07.930721 12558 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:07.930757 12558 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:07.930770 12558 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:07.930781 12558 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:07.930792 12558 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:07.932219 12558 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35829
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39699
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39699
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12558
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:07.932416 12558 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:07.932624 12558 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:07.937192 12566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:07.937330 12558 server_base.cc:1034] running on GCE node
W20260808 05:12:07.937208 12569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:07.937259 12567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:07.937700 12558 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:07.937968 12558 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:07.939132 12558 hybrid_clock.cc:648] HybridClock initialized: now 1786165927939110 us; error 35 us; skew 500 ppm
Aug 08 05:12:07 dist-test-slave-bndk krb5kdc[12539](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165927, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:07.944494 12558 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:07.944929 12558 webserver.cc:460] Webserver started at http://127.0.0.1:42249/ using document root <none> and password file <none>
I20260808 05:12:07.945106 12558 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:07.945147 12558 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:07.945272 12558 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:07.946285 12558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "345d8d470f22433bbcbc08d04997b7ac"
format_stamp: "Formatted at 2026-08-08 05:12:07 on dist-test-slave-bndk"
server_key: "e7d1b24ddc5dfe0d3301e72bd01426e8"
server_key_iv: "9e8defda1632e602f747c6d6b9f18001"
server_key_version: "encryptionkey@0"
I20260808 05:12:07.946587 12558 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "345d8d470f22433bbcbc08d04997b7ac"
format_stamp: "Formatted at 2026-08-08 05:12:07 on dist-test-slave-bndk"
server_key: "e7d1b24ddc5dfe0d3301e72bd01426e8"
server_key_iv: "9e8defda1632e602f747c6d6b9f18001"
server_key_version: "encryptionkey@0"
I20260808 05:12:07.947922 12558 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:12:07.948613 12583 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:07.948788 12558 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:07.948899 12558 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "345d8d470f22433bbcbc08d04997b7ac"
format_stamp: "Formatted at 2026-08-08 05:12:07 on dist-test-slave-bndk"
server_key: "e7d1b24ddc5dfe0d3301e72bd01426e8"
server_key_iv: "9e8defda1632e602f747c6d6b9f18001"
server_key_version: "encryptionkey@0"
I20260808 05:12:07.948961 12558 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:07.952186 12558 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:07.954192 12558 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:07.954296 12558 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:07.958004 12558 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39699
I20260808 05:12:07.958048 12668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39699 every 8 connection(s)
I20260808 05:12:07.958328 12558 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:07.959260 12669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:07.961504 12669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac: Bootstrap starting.
I20260808 05:12:07.962033 12669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:07.962294 12669 log.cc:824] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:07.962934 12669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac: No bootstrap required, opened a new log
I20260808 05:12:07.962940 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 12558
I20260808 05:12:07.963040 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:07.963204 13292 external_mini_cluster.cc:1428] Setting key cdfb9867f677d427192bcd01fa3e0cc2
I20260808 05:12:07.964792 12669 raft_consensus.cc:348] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "345d8d470f22433bbcbc08d04997b7ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39699 } }
I20260808 05:12:07.964941 12669 raft_consensus.cc:374] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:07.964979 12669 raft_consensus.cc:729] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 345d8d470f22433bbcbc08d04997b7ac, State: Initialized, Role: FOLLOWER
I20260808 05:12:07.965150 12669 consensus_queue.cc:260] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "345d8d470f22433bbcbc08d04997b7ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39699 } }
I20260808 05:12:07.965281 12669 raft_consensus.cc:388] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:07.965343 12669 raft_consensus.cc:482] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:07.965396 12669 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:07.966001 12677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:07.963659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:52239 (local address 127.0.0.1:39699)
0808 05:12:07.963847 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:07.963855 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:07.963878 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:12:07.964764 (+ 886us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:07.964770 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:07.964795 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:07.964906 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:07.965571 (+ 665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:07.965575 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:07.965575 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:07.965579 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:07.965617 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:07.965628 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:07.965675 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:07.965760 (+ 85us) server_negotiation.cc:299] Negotiation successful
0808 05:12:07.965796 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":78,"threads_started":1}
I20260808 05:12:07.966395 12669 raft_consensus.cc:504] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "345d8d470f22433bbcbc08d04997b7ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39699 } }
I20260808 05:12:07.966504 12669 leader_election.cc:302] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 345d8d470f22433bbcbc08d04997b7ac; no voters:
I20260808 05:12:07.966656 12669 leader_election.cc:288] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:07.966696 12678 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:07.966842 12678 raft_consensus.cc:686] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [term 1 LEADER]: Becoming Leader. State: Replica: 345d8d470f22433bbcbc08d04997b7ac, State: Running, Role: LEADER
I20260808 05:12:07.966853 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:07.966895 12669 sys_catalog.cc:564] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:07.966933 12678 consensus_queue.cc:237] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "345d8d470f22433bbcbc08d04997b7ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39699 } }
I20260808 05:12:07.967294 12678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "345d8d470f22433bbcbc08d04997b7ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "345d8d470f22433bbcbc08d04997b7ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39699 } } }
I20260808 05:12:07.967375 12678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:07.967536 12678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 345d8d470f22433bbcbc08d04997b7ac. Latest consensus state: current_term: 1 leader_uuid: "345d8d470f22433bbcbc08d04997b7ac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "345d8d470f22433bbcbc08d04997b7ac" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39699 } } }
I20260808 05:12:07.967598 12678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac [sys.catalog]: This master's current role is: LEADER
W20260808 05:12:07.968686 12711 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:12:07.968780 12711 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:12:07.968956 12688 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:07.969102 12688 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:07.970505 12688 catalog_manager.cc:1347] Generated new cluster ID: 33c6cab30539408f8a6d8851649d6084
I20260808 05:12:07.970624 12677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:07.968246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:58671 (local address 127.0.0.1:39699)
0808 05:12:07.968280 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:07.968282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:07.969694 (+ 1412us) server_negotiation.cc:407] Connection header received
0808 05:12:07.969737 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:07.969738 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:07.969744 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:07.969789 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:07.970334 (+ 545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:07.970336 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:07.970336 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:07.970340 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:07.970355 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:07.970359 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:07.970421 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:07.970526 (+ 105us) server_negotiation.cc:299] Negotiation successful
0808 05:12:07.970540 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:12:07.970554 12688 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:07.993345 12688 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:07.993525 12688 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:07.996421 12688 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 345d8d470f22433bbcbc08d04997b7ac: Generated new TSK 0
I20260808 05:12:07.996592 12688 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:08.001497 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 12558
2026-08-08T05:12:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1407 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:08 dist-test-slave-bndk krb5kdc[12719](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:08 dist-test-slave-bndk krb5kdc[12719](info): set up 2 sockets
Aug 08 05:12:08 dist-test-slave-bndk krb5kdc[12719](info): commencing operation
krb5kdc: starting...
W20260808 05:12:09.138561 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.108s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:09 dist-test-slave-bndk krb5kdc[12719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:09.253307 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42821
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:09.334690 12739 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:09.334897 12739 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:09.334919 12739 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:09.336014 12739 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:09.336050 12739 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:09.336062 12739 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:09.336072 12739 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:09.336089 12739 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:09.337543 12739 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42821
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12739
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:09.337739 12739 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:09.337915 12739 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:09.342532 12749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:09.342510 12750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:09.342667 12753 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:09.342583 12739 server_base.cc:1034] running on GCE node
I20260808 05:12:09.342994 12739 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:09.343261 12739 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:09.344405 12739 hybrid_clock.cc:648] HybridClock initialized: now 1786165929344387 us; error 29 us; skew 500 ppm
Aug 08 05:12:09 dist-test-slave-bndk krb5kdc[12719](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165929, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:09.346832 12739 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:09.347281 12739 webserver.cc:460] Webserver started at http://127.0.0.1:38009/ using document root <none> and password file <none>
I20260808 05:12:09.347482 12739 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:09.347532 12739 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:09.347657 12739 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:09.348666 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "699d9b7da01446dab36bc0e30aafa2cf"
format_stamp: "Formatted at 2026-08-08 05:12:09 on dist-test-slave-bndk"
server_key: "009c12a70c18485f46ee97b066511860"
server_key_iv: "269632615427ce47d3bcc5689b76aeca"
server_key_version: "encryptionkey@0"
I20260808 05:12:09.349020 12739 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "699d9b7da01446dab36bc0e30aafa2cf"
format_stamp: "Formatted at 2026-08-08 05:12:09 on dist-test-slave-bndk"
server_key: "009c12a70c18485f46ee97b066511860"
server_key_iv: "269632615427ce47d3bcc5689b76aeca"
server_key_version: "encryptionkey@0"
I20260808 05:12:09.350363 12739 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:09.351049 12764 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:09.351197 12739 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:09.351280 12739 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "699d9b7da01446dab36bc0e30aafa2cf"
format_stamp: "Formatted at 2026-08-08 05:12:09 on dist-test-slave-bndk"
server_key: "009c12a70c18485f46ee97b066511860"
server_key_iv: "269632615427ce47d3bcc5689b76aeca"
server_key_version: "encryptionkey@0"
I20260808 05:12:09.351353 12739 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:09.396481 12739 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:09.398705 12739 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:09.398839 12739 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:09.402743 12739 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42821
I20260808 05:12:09.402786 12842 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42821 every 8 connection(s)
I20260808 05:12:09.403112 12739 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:09.403998 12843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:09.406348 12843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf: Bootstrap starting.
I20260808 05:12:09.406899 12843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:09.407169 12843 log.cc:824] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:09.407868 12843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf: No bootstrap required, opened a new log
I20260808 05:12:09.408015 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 12739
I20260808 05:12:09.408130 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:09.408313 13292 external_mini_cluster.cc:1428] Setting key 2ab6388d263262756cc4bd9a4c7b324a
I20260808 05:12:09.409844 12843 raft_consensus.cc:348] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699d9b7da01446dab36bc0e30aafa2cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42821 } }
I20260808 05:12:09.409993 12843 raft_consensus.cc:374] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:09.410032 12843 raft_consensus.cc:729] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 699d9b7da01446dab36bc0e30aafa2cf, State: Initialized, Role: FOLLOWER
I20260808 05:12:09.410219 12843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699d9b7da01446dab36bc0e30aafa2cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42821 } }
I20260808 05:12:09.410305 12843 raft_consensus.cc:388] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:09.410343 12843 raft_consensus.cc:482] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:09.410390 12843 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:09.411336 12843 raft_consensus.cc:504] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699d9b7da01446dab36bc0e30aafa2cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42821 } }
I20260808 05:12:09.411444 12843 leader_election.cc:302] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 699d9b7da01446dab36bc0e30aafa2cf; no voters:
I20260808 05:12:09.411581 12843 leader_election.cc:288] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:09.411614 12851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:09.411777 12851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [term 1 LEADER]: Becoming Leader. State: Replica: 699d9b7da01446dab36bc0e30aafa2cf, State: Running, Role: LEADER
I20260808 05:12:09.411815 12843 sys_catalog.cc:564] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:09.411870 12851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699d9b7da01446dab36bc0e30aafa2cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42821 } }
I20260808 05:12:09.412237 12851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 699d9b7da01446dab36bc0e30aafa2cf. Latest consensus state: current_term: 1 leader_uuid: "699d9b7da01446dab36bc0e30aafa2cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699d9b7da01446dab36bc0e30aafa2cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42821 } } }
I20260808 05:12:09.412336 12851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:09.412292 12852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "699d9b7da01446dab36bc0e30aafa2cf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "699d9b7da01446dab36bc0e30aafa2cf" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42821 } } }
I20260808 05:12:09.412420 12852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:09.413237 12862 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:09.413885 12862 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:09.415447 12862 catalog_manager.cc:1347] Generated new cluster ID: 2ac9e5cc3c724b4e91db01acb9eda8d6
I20260808 05:12:09.415496 12862 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:12:09 dist-test-slave-bndk krb5kdc[12719](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165929, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260808 05:12:09.419842 12848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:09.408792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:44473 (local address 127.0.0.1:42821)
0808 05:12:09.408960 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:09.408970 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:09.408996 (+ 26us) server_negotiation.cc:407] Connection header received
0808 05:12:09.409816 (+ 820us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:09.409823 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:09.409873 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:09.409980 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:09.410759 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:09.411779 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:09.412803 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:09.413408 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:09.413509 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:09.416143 (+ 2634us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:09.416148 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:09.416148 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:09.416159 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:09.418044 (+ 1885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:09.418452 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:09.418455 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:09.418455 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:09.418602 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:09.418796 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:09.418797 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:09.418798 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:09.419111 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:09.419284 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:09.419362 (+ 78us) server_negotiation.cc:299] Negotiation successful
0808 05:12:09.419462 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":72,"threads_started":1}
I20260808 05:12:09.420799 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:09.423563 12862 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:09.424189 12862 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:09.426611 12862 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 699d9b7da01446dab36bc0e30aafa2cf: Generated new TSK 0
I20260808 05:12:09.426769 12862 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:09.428925 12848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:09.422401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:51351 (local address 127.0.0.1:42821)
0808 05:12:09.422443 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:09.422445 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:09.422455 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:12:09.422489 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:09.422490 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:09.422499 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:09.422538 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:09.423288 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:09.424005 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:09.424988 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:09.425327 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:09.425388 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:09.426671 (+ 1283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:09.426673 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:09.426673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:09.426679 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:09.427957 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:09.428331 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:09.428332 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:09.428332 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:09.428374 (+ 42us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:09.428548 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:09.428549 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:09.428549 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:09.428632 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:09.428702 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:09.428829 (+ 127us) server_negotiation.cc:299] Negotiation successful
0808 05:12:09.428871 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:12:09.430647 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 12739
W20260808 05:12:09.442878 12717 connection.cc:535] client connection to 127.0.0.1:42821 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:42821): Connection reset by peer (error 104)
2026-08-08T05:12:09Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1426 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:09 dist-test-slave-bndk krb5kdc[12891](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:09 dist-test-slave-bndk krb5kdc[12891](info): set up 2 sockets
Aug 08 05:12:09 dist-test-slave-bndk krb5kdc[12891](info): commencing operation
krb5kdc: starting...
W20260808 05:12:10.565752 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.109s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:10 dist-test-slave-bndk krb5kdc[12891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165930, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:10.681609 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33185
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46843
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33185
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:10.761382 12913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:10.761565 12913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:10.761587 12913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:10.762701 12913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:10.762741 12913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:10.762754 12913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:10.762766 12913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:10.762784 12913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:10.764160 12913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46843
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33185
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33185
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:10.764340 12913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:10.764504 12913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:10.769081 12931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:10.769052 12925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:10.769044 12928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:10.769104 12913 server_base.cc:1034] running on GCE node
I20260808 05:12:10.769461 12913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:10.769729 12913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:10.770869 12913 hybrid_clock.cc:648] HybridClock initialized: now 1786165930770855 us; error 25 us; skew 500 ppm
Aug 08 05:12:10 dist-test-slave-bndk krb5kdc[12891](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165930, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:10.773089 12913 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:10.773536 12913 webserver.cc:460] Webserver started at http://127.0.0.1:46219/ using document root <none> and password file <none>
I20260808 05:12:10.773736 12913 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:10.773782 12913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:10.773903 12913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:10.774853 12913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "7856883ace49430aa7b64e0ebc6f3131"
format_stamp: "Formatted at 2026-08-08 05:12:10 on dist-test-slave-bndk"
server_key: "d638ffd3deae586d7133e1f3dc6f5dab"
server_key_iv: "49bdb2a899ddb8ab2264b01269473769"
server_key_version: "encryptionkey@0"
I20260808 05:12:10.775170 12913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "7856883ace49430aa7b64e0ebc6f3131"
format_stamp: "Formatted at 2026-08-08 05:12:10 on dist-test-slave-bndk"
server_key: "d638ffd3deae586d7133e1f3dc6f5dab"
server_key_iv: "49bdb2a899ddb8ab2264b01269473769"
server_key_version: "encryptionkey@0"
I20260808 05:12:10.776347 12913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:12:10.776997 12938 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:10.777139 12913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:12:10.777240 12913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "7856883ace49430aa7b64e0ebc6f3131"
format_stamp: "Formatted at 2026-08-08 05:12:10 on dist-test-slave-bndk"
server_key: "d638ffd3deae586d7133e1f3dc6f5dab"
server_key_iv: "49bdb2a899ddb8ab2264b01269473769"
server_key_version: "encryptionkey@0"
I20260808 05:12:10.777307 12913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:10.789995 12913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:10.791600 12913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:10.791733 12913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:10.795475 12913 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33185
I20260808 05:12:10.795516 13016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33185 every 8 connection(s)
I20260808 05:12:10.795826 12913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:10.796658 13020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:10.798894 13020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131: Bootstrap starting.
I20260808 05:12:10.799402 13020 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:10.799649 13020 log.cc:824] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:10.800247 13020 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131: No bootstrap required, opened a new log
I20260808 05:12:10.801837 13020 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7856883ace49430aa7b64e0ebc6f3131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33185 } }
I20260808 05:12:10.801971 13020 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:10.801992 13020 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7856883ace49430aa7b64e0ebc6f3131, State: Initialized, Role: FOLLOWER
I20260808 05:12:10.802091 13020 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7856883ace49430aa7b64e0ebc6f3131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33185 } }
I20260808 05:12:10.802138 13020 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:10.802162 13020 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:10.802189 13020 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:10.802650 13020 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7856883ace49430aa7b64e0ebc6f3131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33185 } }
I20260808 05:12:10.802739 13020 leader_election.cc:302] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7856883ace49430aa7b64e0ebc6f3131; no voters:
I20260808 05:12:10.802855 13020 leader_election.cc:288] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:10.802896 13024 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:10.803059 13020 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:10.803088 13024 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [term 1 LEADER]: Becoming Leader. State: Replica: 7856883ace49430aa7b64e0ebc6f3131, State: Running, Role: LEADER
I20260808 05:12:10.803187 13024 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7856883ace49430aa7b64e0ebc6f3131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33185 } }
I20260808 05:12:10.803542 13025 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7856883ace49430aa7b64e0ebc6f3131" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7856883ace49430aa7b64e0ebc6f3131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33185 } } }
I20260808 05:12:10.803622 13025 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:10.803664 13026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7856883ace49430aa7b64e0ebc6f3131. Latest consensus state: current_term: 1 leader_uuid: "7856883ace49430aa7b64e0ebc6f3131" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7856883ace49430aa7b64e0ebc6f3131" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33185 } } }
I20260808 05:12:10.803717 13026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:10.803898 13034 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:10.804418 13034 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:10.805907 13034 catalog_manager.cc:1347] Generated new cluster ID: 21e3e45d817b4d41b123e82870b390e1
I20260808 05:12:10.805960 13034 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:10.806066 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 12913
I20260808 05:12:10.806187 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:10.806365 13292 external_mini_cluster.cc:1428] Setting key fc12d5f9f48472475b19cbd9f6457781
I20260808 05:12:10.822796 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:10.806791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:41837 (local address 127.0.0.1:33185)
0808 05:12:10.806953 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:10.806962 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:10.817446 (+ 10484us) server_negotiation.cc:407] Connection header received
0808 05:12:10.817578 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:10.817586 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:10.817647 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:10.817785 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:10.818067 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:10.819518 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:10.820562 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:10.821183 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:10.821340 (+ 157us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:10.822013 (+ 673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:10.822017 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:10.822018 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:10.822240 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:10.822280 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:10.822295 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:10.822381 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:10.822557 (+ 176us) server_negotiation.cc:299] Negotiation successful
0808 05:12:10.822589 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
I20260808 05:12:10.823719 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:10.828604 13052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:10.825193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:35277 (local address 127.0.0.1:33185)
0808 05:12:10.825239 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:10.825241 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:10.825391 (+ 150us) server_negotiation.cc:407] Connection header received
0808 05:12:10.825460 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:10.825460 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:10.825470 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:10.825532 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:10.825650 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:10.826329 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:10.827365 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:10.827687 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:10.827742 (+ 55us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:10.828361 (+ 619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:10.828362 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:10.828363 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:10.828366 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:10.828379 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:10.828383 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:10.828432 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:10.828523 (+ 91us) server_negotiation.cc:299] Negotiation successful
0808 05:12:10.828534 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 05:12:10.838289 13034 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:10.838783 13034 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:10.840898 13034 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7856883ace49430aa7b64e0ebc6f3131: Generated new TSK 0
I20260808 05:12:10.841060 13034 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:10.846194 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 12913
W20260808 05:12:10.859571 12889 connection.cc:535] client connection to 127.0.0.1:33185 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33185): Connection reset by peer (error 104)
2026-08-08T05:12:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1416 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:10 dist-test-slave-bndk krb5kdc[13060](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:10 dist-test-slave-bndk krb5kdc[13060](info): set up 2 sockets
Aug 08 05:12:10 dist-test-slave-bndk krb5kdc[13060](info): commencing operation
krb5kdc: starting...
W20260808 05:12:11.977779 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.105s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:12 dist-test-slave-bndk krb5kdc[13060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165932, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260808 05:12:12.092932 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38465
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33019
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38465
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:12.173089 13082 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:12.173332 13082 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:12.173367 13082 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:12.174492 13082 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:12.174533 13082 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:12.174551 13082 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:12.174568 13082 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:12.174582 13082 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:12.176013 13082 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33019
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38465
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38465
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13082
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:12.176246 13082 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:12.176463 13082 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:12.181142 13095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:12.181252 13094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:12.181141 13098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:12.181354 13082 server_base.cc:1034] running on GCE node
I20260808 05:12:12.181608 13082 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:12.181857 13082 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:12.182994 13082 hybrid_clock.cc:648] HybridClock initialized: now 1786165932182977 us; error 33 us; skew 500 ppm
Aug 08 05:12:12 dist-test-slave-bndk krb5kdc[13060](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165932, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:12.186088 13082 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260808 05:12:12.186611 13082 webserver.cc:460] Webserver started at http://127.0.0.1:33249/ using document root <none> and password file <none>
I20260808 05:12:12.186867 13082 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:12.186913 13082 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:12.187047 13082 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:12.188055 13082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "785b47f5025b43289ff47d058e2a5c6f"
format_stamp: "Formatted at 2026-08-08 05:12:12 on dist-test-slave-bndk"
server_key: "4fa18f2242e01a3bf9b03cf0d7eceae8"
server_key_iv: "db6b83abf559b5b1c56c1180a98f5d71"
server_key_version: "encryptionkey@0"
I20260808 05:12:12.188367 13082 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "785b47f5025b43289ff47d058e2a5c6f"
format_stamp: "Formatted at 2026-08-08 05:12:12 on dist-test-slave-bndk"
server_key: "4fa18f2242e01a3bf9b03cf0d7eceae8"
server_key_iv: "db6b83abf559b5b1c56c1180a98f5d71"
server_key_version: "encryptionkey@0"
I20260808 05:12:12.189635 13082 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:12.190249 13114 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:12.190398 13082 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:12.190478 13082 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "785b47f5025b43289ff47d058e2a5c6f"
format_stamp: "Formatted at 2026-08-08 05:12:12 on dist-test-slave-bndk"
server_key: "4fa18f2242e01a3bf9b03cf0d7eceae8"
server_key_iv: "db6b83abf559b5b1c56c1180a98f5d71"
server_key_version: "encryptionkey@0"
I20260808 05:12:12.190549 13082 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:12.193709 13082 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:12.195668 13082 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:12.195793 13082 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:12.199546 13082 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38465
I20260808 05:12:12.199599 13184 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38465 every 8 connection(s)
I20260808 05:12:12.199864 13082 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:12.200765 13185 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:12.202919 13185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f: Bootstrap starting.
I20260808 05:12:12.203454 13185 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:12.203716 13185 log.cc:824] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:12.204355 13185 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f: No bootstrap required, opened a new log
I20260808 05:12:12.205987 13185 raft_consensus.cc:348] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "785b47f5025b43289ff47d058e2a5c6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38465 } }
I20260808 05:12:12.206120 13185 raft_consensus.cc:374] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:12.206143 13185 raft_consensus.cc:729] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 785b47f5025b43289ff47d058e2a5c6f, State: Initialized, Role: FOLLOWER
I20260808 05:12:12.206276 13185 consensus_queue.cc:260] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "785b47f5025b43289ff47d058e2a5c6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38465 } }
I20260808 05:12:12.206349 13185 raft_consensus.cc:388] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:12.206383 13185 raft_consensus.cc:482] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:12.206436 13185 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:12.206929 13185 raft_consensus.cc:504] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "785b47f5025b43289ff47d058e2a5c6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38465 } }
I20260808 05:12:12.207026 13185 leader_election.cc:302] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 785b47f5025b43289ff47d058e2a5c6f; no voters:
I20260808 05:12:12.207141 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13082
I20260808 05:12:12.207186 13185 leader_election.cc:288] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:12.207221 13189 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:12.207268 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:12.207357 13189 raft_consensus.cc:686] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [term 1 LEADER]: Becoming Leader. State: Replica: 785b47f5025b43289ff47d058e2a5c6f, State: Running, Role: LEADER
I20260808 05:12:12.207448 13185 sys_catalog.cc:564] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:12.207458 13292 external_mini_cluster.cc:1428] Setting key 658ba50868ca3011d39a16dafdc6c0c2
I20260808 05:12:12.207429 13189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "785b47f5025b43289ff47d058e2a5c6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38465 } }
I20260808 05:12:12.207850 13192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 785b47f5025b43289ff47d058e2a5c6f. Latest consensus state: current_term: 1 leader_uuid: "785b47f5025b43289ff47d058e2a5c6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "785b47f5025b43289ff47d058e2a5c6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38465 } } }
I20260808 05:12:12.208068 13192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:12.208003 13191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "785b47f5025b43289ff47d058e2a5c6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "785b47f5025b43289ff47d058e2a5c6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38465 } } }
I20260808 05:12:12.208309 13191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:12.208331 13198 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:12.208884 13198 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:12.210014 13195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:12.207891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:49393 (local address 127.0.0.1:38465)
0808 05:12:12.208476 (+ 585us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:12.208485 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:12.208525 (+ 40us) server_negotiation.cc:407] Connection header received
0808 05:12:12.208641 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:12.208649 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:12.208681 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:12.208819 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:12.209587 (+ 768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:12.209590 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:12.209590 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:12.209595 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:12.209642 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:12.209656 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:12.209717 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:12.209806 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:12:12.209846 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":537,"thread_start_us":72,"threads_started":1}
I20260808 05:12:12.210572 13198 catalog_manager.cc:1347] Generated new cluster ID: 3ac34ae6a4f949b0be83bcf4e6b95599
I20260808 05:12:12.210623 13198 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:12.210925 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:12.214322 13195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:12.212282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.55:47271 (local address 127.0.0.1:38465)
0808 05:12:12.212312 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:12.212314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:12.213481 (+ 1167us) server_negotiation.cc:407] Connection header received
0808 05:12:12.213536 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:12.213537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:12.213542 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:12.213609 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:12.214123 (+ 514us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:12.214124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:12.214124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:12.214129 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:12.214144 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:12.214148 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:12.214200 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:12.214249 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 05:12:12.214262 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:12:12.225196 13198 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:12.225366 13198 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:12.231603 13198 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 785b47f5025b43289ff47d058e2a5c6f: Generated new TSK 0
I20260808 05:12:12.231768 13198 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:12.233987 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13082
2026-08-08T05:12:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1385 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:12 dist-test-slave-bndk krb5kdc[13230](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:12 dist-test-slave-bndk krb5kdc[13230](info): set up 2 sockets
Aug 08 05:12:12 dist-test-slave-bndk krb5kdc[13230](info): commencing operation
krb5kdc: starting...
W20260808 05:12:13.359810 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.102s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:13 dist-test-slave-bndk krb5kdc[13230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:13Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:13.479889 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44689
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:32979
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:44689
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:13.562674 13250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:13.562885 13250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:13.562914 13250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:13.564031 13250 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:13.564072 13250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:13.564091 13250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:13.564106 13250 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:13.564121 13250 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:13.565596 13250 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:32979
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:44689
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44689
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:13.565841 13250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:13.566051 13250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:13.570655 13263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:13.570699 13256 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:13.570663 13260 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:13.570899 13250 server_base.cc:1034] running on GCE node
I20260808 05:12:13.571117 13250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:13.571425 13250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:13.572584 13250 hybrid_clock.cc:648] HybridClock initialized: now 1786165933572561 us; error 32 us; skew 500 ppm
Aug 08 05:12:13 dist-test-slave-bndk krb5kdc[13230](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165933, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:13.578146 13250 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:13.578655 13250 webserver.cc:460] Webserver started at http://127.12.251.62:42063/ using document root <none> and password file <none>
I20260808 05:12:13.578874 13250 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:13.578925 13250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:13.579063 13250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:13.580125 13250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "fdca3d77d47a44ae8c54912262d59c59"
format_stamp: "Formatted at 2026-08-08 05:12:13 on dist-test-slave-bndk"
server_key: "edc9b5e58bf8c4e508a6c5f6de47c7c8"
server_key_iv: "a2d409d2c608e5969ecd9b7291b21bb3"
server_key_version: "encryptionkey@0"
I20260808 05:12:13.580473 13250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "fdca3d77d47a44ae8c54912262d59c59"
format_stamp: "Formatted at 2026-08-08 05:12:13 on dist-test-slave-bndk"
server_key: "edc9b5e58bf8c4e508a6c5f6de47c7c8"
server_key_iv: "a2d409d2c608e5969ecd9b7291b21bb3"
server_key_version: "encryptionkey@0"
I20260808 05:12:13.581851 13250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:13.582531 13274 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:13.582684 13250 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:13.582768 13250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "fdca3d77d47a44ae8c54912262d59c59"
format_stamp: "Formatted at 2026-08-08 05:12:13 on dist-test-slave-bndk"
server_key: "edc9b5e58bf8c4e508a6c5f6de47c7c8"
server_key_iv: "a2d409d2c608e5969ecd9b7291b21bb3"
server_key_version: "encryptionkey@0"
I20260808 05:12:13.582827 13250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:13.595423 13250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:13.597095 13250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:13.597280 13250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:13.601032 13250 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:44689
I20260808 05:12:13.601068 13354 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:44689 every 8 connection(s)
I20260808 05:12:13.601413 13250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:13.602273 13355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:13.604496 13355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59: Bootstrap starting.
I20260808 05:12:13.604835 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13250
I20260808 05:12:13.604957 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:13.605063 13355 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:13.605119 13292 external_mini_cluster.cc:1428] Setting key c7e39fcfa1d2eecf228cefdcf46dede2
I20260808 05:12:13.605381 13355 log.cc:824] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:13.606081 13355 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59: No bootstrap required, opened a new log
I20260808 05:12:13.607908 13355 raft_consensus.cc:348] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdca3d77d47a44ae8c54912262d59c59" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44689 } }
I20260808 05:12:13.608047 13355 raft_consensus.cc:374] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:13.608080 13355 raft_consensus.cc:729] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdca3d77d47a44ae8c54912262d59c59, State: Initialized, Role: FOLLOWER
I20260808 05:12:13.608201 13355 consensus_queue.cc:260] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdca3d77d47a44ae8c54912262d59c59" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44689 } }
I20260808 05:12:13.608276 13355 raft_consensus.cc:388] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:13.608307 13355 raft_consensus.cc:482] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:13.608354 13355 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:13.608861 13355 raft_consensus.cc:504] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdca3d77d47a44ae8c54912262d59c59" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44689 } }
I20260808 05:12:13.608956 13355 leader_election.cc:302] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdca3d77d47a44ae8c54912262d59c59; no voters:
I20260808 05:12:13.609107 13355 leader_election.cc:288] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:13.609148 13360 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:13.609316 13360 raft_consensus.cc:686] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [term 1 LEADER]: Becoming Leader. State: Replica: fdca3d77d47a44ae8c54912262d59c59, State: Running, Role: LEADER
I20260808 05:12:13.609388 13355 sys_catalog.cc:564] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:13.609426 13360 consensus_queue.cc:237] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdca3d77d47a44ae8c54912262d59c59" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44689 } }
I20260808 05:12:13.609737 13360 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdca3d77d47a44ae8c54912262d59c59. Latest consensus state: current_term: 1 leader_uuid: "fdca3d77d47a44ae8c54912262d59c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdca3d77d47a44ae8c54912262d59c59" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44689 } } }
I20260808 05:12:13.609802 13360 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:13.610028 13362 sys_catalog.cc:455] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdca3d77d47a44ae8c54912262d59c59" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdca3d77d47a44ae8c54912262d59c59" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44689 } } }
I20260808 05:12:13.610136 13362 sys_catalog.cc:458] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:13.610566 13366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:13.611220 13366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 08 05:12:13 dist-test-slave-bndk krb5kdc[13230](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165933, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:12:13.612764 13366 catalog_manager.cc:1347] Generated new cluster ID: b80bfa18868e4ef484ded0794e18776b
I20260808 05:12:13.612816 13366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:13.616173 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:13.605611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44945 (local address 127.12.251.62:44689)
0808 05:12:13.605766 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:13.605774 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:13.605799 (+ 25us) server_negotiation.cc:407] Connection header received
0808 05:12:13.606251 (+ 452us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:13.606259 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:13.606308 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:13.606437 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:13.607061 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:13.607919 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:13.608762 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:13.609254 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:13.609708 (+ 454us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:13.612198 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:13.612202 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:13.612203 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:13.612215 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:13.614146 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:13.614560 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:13.614562 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:13.614563 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:13.614659 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:13.614869 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:13.614869 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:13.614870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:13.615145 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:13.615653 (+ 508us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:13.615742 (+ 89us) server_negotiation.cc:299] Negotiation successful
0808 05:12:13.615832 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":65,"threads_started":1}
I20260808 05:12:13.616899 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:13.625178 13359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:13.618276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39083 (local address 127.12.251.62:44689)
0808 05:12:13.618307 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:13.618309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:13.618415 (+ 106us) server_negotiation.cc:407] Connection header received
0808 05:12:13.618483 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:13.618484 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:13.618492 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:13.618547 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:13.619149 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:13.619884 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:13.620892 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:13.621260 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:13.621305 (+ 45us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:13.622623 (+ 1318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:13.622624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:13.622624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:13.622631 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:13.624067 (+ 1436us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:13.624470 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:13.624471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:13.624472 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:13.624520 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:13.624710 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:13.624710 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:13.624711 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:13.624815 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:13.624900 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:13.625034 (+ 134us) server_negotiation.cc:299] Negotiation successful
0808 05:12:13.625091 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260808 05:12:13.628192 13366 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:13.628691 13366 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:13.631668 13366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fdca3d77d47a44ae8c54912262d59c59: Generated new TSK 0
I20260808 05:12:13.631855 13366 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:13.640664 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13250
W20260808 05:12:13.659132 13225 connection.cc:535] client connection to 127.12.251.62:44689 recv error: Network error: failed to read from TLS socket (remote: 127.12.251.62:44689): Connection reset by peer (error 104)
2026-08-08T05:12:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:13 dist-test-slave-bndk krb5kdc[13407](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:13 dist-test-slave-bndk krb5kdc[13407](info): set up 2 sockets
Aug 08 05:12:13 dist-test-slave-bndk krb5kdc[13407](info): commencing operation
krb5kdc: starting...
W20260808 05:12:14.771216 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:14 dist-test-slave-bndk krb5kdc[13407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165934, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:14.885522 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33969
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34901
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:33969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:14.965065 13425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:14.965271 13425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:14.965293 13425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:14.966354 13425 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:14.966385 13425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:14.966398 13425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:14.966408 13425 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:14.966423 13425 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:14.967818 13425 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34901
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:33969
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:33969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:14.967999 13425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:14.968180 13425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:14.972798 13439 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:14.972846 13432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:14.972787 13434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:14.973125 13425 server_base.cc:1034] running on GCE node
I20260808 05:12:14.973371 13425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:14.973649 13425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:14.974778 13425 hybrid_clock.cc:648] HybridClock initialized: now 1786165934974764 us; error 35 us; skew 500 ppm
Aug 08 05:12:14 dist-test-slave-bndk krb5kdc[13407](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165934, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:14.977067 13425 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:14.977480 13425 webserver.cc:460] Webserver started at http://127.12.251.62:37315/ using document root <none> and password file <none>
I20260808 05:12:14.977676 13425 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:14.977715 13425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:14.977805 13425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:14.978782 13425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "db2772a832224be2ad1b2725f55ef104"
format_stamp: "Formatted at 2026-08-08 05:12:14 on dist-test-slave-bndk"
server_key: "4709f90debcf4a7b8c7ca26e95f0f19d"
server_key_iv: "d61a51af671e1b63c1aa6f6d9e7d6282"
server_key_version: "encryptionkey@0"
I20260808 05:12:14.979065 13425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "db2772a832224be2ad1b2725f55ef104"
format_stamp: "Formatted at 2026-08-08 05:12:14 on dist-test-slave-bndk"
server_key: "4709f90debcf4a7b8c7ca26e95f0f19d"
server_key_iv: "d61a51af671e1b63c1aa6f6d9e7d6282"
server_key_version: "encryptionkey@0"
I20260808 05:12:14.980249 13425 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:14.980898 13447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:14.981050 13425 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:14.981132 13425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "db2772a832224be2ad1b2725f55ef104"
format_stamp: "Formatted at 2026-08-08 05:12:14 on dist-test-slave-bndk"
server_key: "4709f90debcf4a7b8c7ca26e95f0f19d"
server_key_iv: "d61a51af671e1b63c1aa6f6d9e7d6282"
server_key_version: "encryptionkey@0"
I20260808 05:12:14.981191 13425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:14.992141 13425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:14.994143 13425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:14.994270 13425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:14.997956 13425 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:33969
I20260808 05:12:14.997993 13521 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:33969 every 8 connection(s)
I20260808 05:12:14.998315 13425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:14.999145 13524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:14.999665 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13425
I20260808 05:12:14.999780 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:14.999959 13292 external_mini_cluster.cc:1428] Setting key 6d23d327c1e56051a6568844bfdadbb7
I20260808 05:12:15.001811 13524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104: Bootstrap starting.
I20260808 05:12:15.002373 13524 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:15.002683 13524 log.cc:824] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:15.003398 13524 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104: No bootstrap required, opened a new log
I20260808 05:12:15.005066 13528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:15.000459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37467 (local address 127.12.251.62:33969)
0808 05:12:15.000613 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:15.000621 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:15.000645 (+ 24us) server_negotiation.cc:407] Connection header received
0808 05:12:15.001035 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:15.001042 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:15.001085 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:15.001204 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:15.001451 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:15.002334 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:15.003298 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:15.003723 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:15.003815 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:15.004477 (+ 662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:15.004482 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:15.004482 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:15.004631 (+ 149us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:15.004659 (+ 28us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:15.004669 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:15.004727 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:15.004845 (+ 118us) server_negotiation.cc:299] Negotiation successful
0808 05:12:15.004873 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":107,"thread_start_us":61,"threads_started":1}
I20260808 05:12:15.005522 13524 raft_consensus.cc:348] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2772a832224be2ad1b2725f55ef104" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33969 } }
I20260808 05:12:15.005693 13524 raft_consensus.cc:374] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:15.005743 13524 raft_consensus.cc:729] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db2772a832224be2ad1b2725f55ef104, State: Initialized, Role: FOLLOWER
I20260808 05:12:15.005877 13524 consensus_queue.cc:260] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2772a832224be2ad1b2725f55ef104" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33969 } }
I20260808 05:12:15.005962 13524 raft_consensus.cc:388] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:15.006004 13524 raft_consensus.cc:482] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:15.006047 13524 raft_consensus.cc:3037] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:15.006069 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:15.006553 13524 raft_consensus.cc:504] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2772a832224be2ad1b2725f55ef104" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33969 } }
I20260808 05:12:15.006640 13524 leader_election.cc:302] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: db2772a832224be2ad1b2725f55ef104; no voters:
I20260808 05:12:15.006793 13524 leader_election.cc:288] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:15.006845 13531 raft_consensus.cc:2781] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:15.007018 13524 sys_catalog.cc:564] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:15.007061 13531 raft_consensus.cc:686] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [term 1 LEADER]: Becoming Leader. State: Replica: db2772a832224be2ad1b2725f55ef104, State: Running, Role: LEADER
I20260808 05:12:15.007187 13531 consensus_queue.cc:237] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2772a832224be2ad1b2725f55ef104" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33969 } }
I20260808 05:12:15.007558 13532 sys_catalog.cc:455] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "db2772a832224be2ad1b2725f55ef104" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2772a832224be2ad1b2725f55ef104" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33969 } } }
I20260808 05:12:15.007642 13532 sys_catalog.cc:458] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:15.007853 13539 sys_catalog.cc:455] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [sys.catalog]: SysCatalogTable state changed. Reason: New leader db2772a832224be2ad1b2725f55ef104. Latest consensus state: current_term: 1 leader_uuid: "db2772a832224be2ad1b2725f55ef104" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "db2772a832224be2ad1b2725f55ef104" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 33969 } } }
I20260808 05:12:15.007963 13539 sys_catalog.cc:458] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:15.008348 13548 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:15.008860 13548 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:15.010299 13548 catalog_manager.cc:1347] Generated new cluster ID: 604a0e4e8d784a15a0400cb13d63b53f
I20260808 05:12:15.010355 13548 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:15.011137 13528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:15.007427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55505 (local address 127.12.251.62:33969)
0808 05:12:15.007457 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:15.007459 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:15.008202 (+ 743us) server_negotiation.cc:407] Connection header received
0808 05:12:15.008255 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:15.008256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:15.008266 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:15.008312 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:15.008565 (+ 253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:15.009241 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:15.009946 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:15.010225 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:15.010284 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:15.010959 (+ 675us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:15.010961 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:15.010961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:15.010964 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:15.010977 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:15.010980 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:15.011033 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:15.011081 (+ 48us) server_negotiation.cc:299] Negotiation successful
0808 05:12:15.011090 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 05:12:15.023583 13548 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:15.024085 13548 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:15.038592 13548 catalog_manager.cc:5868] T 00000000000000000000000000000000 P db2772a832224be2ad1b2725f55ef104: Generated new TSK 0
I20260808 05:12:15.038769 13548 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:15.044587 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13425
W20260808 05:12:15.057960 13404 connection.cc:535] client connection to 127.12.251.62:33969 recv error: Network error: failed to read from TLS socket (remote: 127.12.251.62:33969): Connection reset by peer (error 104)
2026-08-08T05:12:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1398 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:15 dist-test-slave-bndk krb5kdc[13566](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:15 dist-test-slave-bndk krb5kdc[13566](info): set up 2 sockets
Aug 08 05:12:15 dist-test-slave-bndk krb5kdc[13566](info): commencing operation
krb5kdc: starting...
W20260808 05:12:16.171527 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.100s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:16 dist-test-slave-bndk krb5kdc[13566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165936, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:16Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:16.283746 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:41179
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:34845
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:41179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:16.366102 13582 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:16.366305 13582 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:16.366346 13582 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:16.367472 13582 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:16.367514 13582 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:16.367532 13582 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:16.367548 13582 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:16.367563 13582 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:16.369096 13582 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:34845
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:41179
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:41179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13582
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:16.369374 13582 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:16.369590 13582 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:16.374503 13591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:16.374560 13588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:16.374542 13589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:16.374573 13582 server_base.cc:1034] running on GCE node
I20260808 05:12:16.374918 13582 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:16.375185 13582 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:16.376317 13582 hybrid_clock.cc:648] HybridClock initialized: now 1786165936376299 us; error 34 us; skew 500 ppm
Aug 08 05:12:16 dist-test-slave-bndk krb5kdc[13566](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165936, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:16.378633 13582 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:16.379060 13582 webserver.cc:460] Webserver started at http://127.12.251.62:41695/ using document root <none> and password file <none>
I20260808 05:12:16.379276 13582 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:16.379318 13582 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:16.379437 13582 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:16.380429 13582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "03adb427b5394ce5a20c83781b173367"
format_stamp: "Formatted at 2026-08-08 05:12:16 on dist-test-slave-bndk"
server_key: "9788350bc2529676463a15ed97889e8c"
server_key_iv: "6c08f41a48c6c5733366f19e4ebd3674"
server_key_version: "encryptionkey@0"
I20260808 05:12:16.380751 13582 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "03adb427b5394ce5a20c83781b173367"
format_stamp: "Formatted at 2026-08-08 05:12:16 on dist-test-slave-bndk"
server_key: "9788350bc2529676463a15ed97889e8c"
server_key_iv: "6c08f41a48c6c5733366f19e4ebd3674"
server_key_version: "encryptionkey@0"
I20260808 05:12:16.382015 13582 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:12:16.382647 13599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:16.382776 13582 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:12:16.382848 13582 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "03adb427b5394ce5a20c83781b173367"
format_stamp: "Formatted at 2026-08-08 05:12:16 on dist-test-slave-bndk"
server_key: "9788350bc2529676463a15ed97889e8c"
server_key_iv: "6c08f41a48c6c5733366f19e4ebd3674"
server_key_version: "encryptionkey@0"
I20260808 05:12:16.382907 13582 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:16.386090 13582 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:16.387754 13582 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:16.387877 13582 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:16.391685 13582 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:41179
I20260808 05:12:16.391717 13675 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:41179 every 8 connection(s)
I20260808 05:12:16.392014 13582 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:16.392912 13677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:16.395128 13677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367: Bootstrap starting.
I20260808 05:12:16.395649 13677 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:16.395874 13677 log.cc:824] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:16.396492 13677 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367: No bootstrap required, opened a new log
I20260808 05:12:16.398290 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13582
I20260808 05:12:16.398408 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:16.398296 13677 raft_consensus.cc:348] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03adb427b5394ce5a20c83781b173367" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 41179 } }
I20260808 05:12:16.398465 13677 raft_consensus.cc:374] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:16.398510 13677 raft_consensus.cc:729] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03adb427b5394ce5a20c83781b173367, State: Initialized, Role: FOLLOWER
I20260808 05:12:16.398605 13292 external_mini_cluster.cc:1428] Setting key bda21f21e878bc5c6c103fc7bda2b4a6
I20260808 05:12:16.398654 13677 consensus_queue.cc:260] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03adb427b5394ce5a20c83781b173367" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 41179 } }
I20260808 05:12:16.398737 13677 raft_consensus.cc:388] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:16.398815 13677 raft_consensus.cc:482] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:16.398855 13677 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:16.399806 13677 raft_consensus.cc:504] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03adb427b5394ce5a20c83781b173367" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 41179 } }
I20260808 05:12:16.399909 13677 leader_election.cc:302] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 03adb427b5394ce5a20c83781b173367; no voters:
I20260808 05:12:16.400069 13677 leader_election.cc:288] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:16.400118 13684 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:16.400308 13677 sys_catalog.cc:564] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:16.400308 13684 raft_consensus.cc:686] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [term 1 LEADER]: Becoming Leader. State: Replica: 03adb427b5394ce5a20c83781b173367, State: Running, Role: LEADER
I20260808 05:12:16.400494 13684 consensus_queue.cc:237] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03adb427b5394ce5a20c83781b173367" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 41179 } }
I20260808 05:12:16.400803 13683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:16.399096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44517 (local address 127.12.251.62:41179)
0808 05:12:16.399250 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:16.399259 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:16.399289 (+ 30us) server_negotiation.cc:407] Connection header received
0808 05:12:16.399389 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:16.399394 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:16.399416 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:16.399524 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:16.400195 (+ 671us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:16.400199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:16.400199 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:16.400204 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:16.400249 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:16.400264 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:16.400333 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:16.400591 (+ 258us) server_negotiation.cc:299] Negotiation successful
0808 05:12:16.400635 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":72,"threads_started":1}
I20260808 05:12:16.400938 13686 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "03adb427b5394ce5a20c83781b173367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03adb427b5394ce5a20c83781b173367" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 41179 } } }
I20260808 05:12:16.401059 13686 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:16.400851 13687 sys_catalog.cc:455] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 03adb427b5394ce5a20c83781b173367. Latest consensus state: current_term: 1 leader_uuid: "03adb427b5394ce5a20c83781b173367" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "03adb427b5394ce5a20c83781b173367" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 41179 } } }
I20260808 05:12:16.401319 13687 sys_catalog.cc:458] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:16.401806 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:16.401754 13698 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:16.402354 13698 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:16.403839 13698 catalog_manager.cc:1347] Generated new cluster ID: 696561967a2f41dca713aee475d14c0b
I20260808 05:12:16.403890 13698 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:16.406245 13683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:16.403296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44431 (local address 127.12.251.62:41179)
0808 05:12:16.403326 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:16.403328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:16.405385 (+ 2057us) server_negotiation.cc:407] Connection header received
0808 05:12:16.405444 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:16.405445 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:16.405450 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:16.405498 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:16.406035 (+ 537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:16.406036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:16.406037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:16.406041 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:16.406055 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:16.406059 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:16.406105 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:16.406146 (+ 41us) server_negotiation.cc:299] Negotiation successful
0808 05:12:16.406158 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 05:12:16.419564 13698 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:16.419759 13698 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:16.423939 13698 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 03adb427b5394ce5a20c83781b173367: Generated new TSK 0
I20260808 05:12:16.424135 13698 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:16.426851 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13582
2026-08-08T05:12:16Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1381 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:16 dist-test-slave-bndk krb5kdc[13717](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:16 dist-test-slave-bndk krb5kdc[13717](info): set up 2 sockets
Aug 08 05:12:16 dist-test-slave-bndk krb5kdc[13717](info): commencing operation
krb5kdc: starting...
W20260808 05:12:17.546804 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.094s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:17 dist-test-slave-bndk krb5kdc[13717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:17.660337 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45753
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:37149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:45753
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:17.754091 13738 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:17.754288 13738 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:17.754319 13738 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:17.755426 13738 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:17.755468 13738 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:17.755487 13738 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:17.755501 13738 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:17.755518 13738 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:17.756987 13738 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:37149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:45753
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:45753
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13738
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:17.757246 13738 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:17.757472 13738 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:17.762117 13748 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:17.762210 13738 server_base.cc:1034] running on GCE node
W20260808 05:12:17.762084 13743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:17.762071 13745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:17.762562 13738 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:17.762831 13738 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:17.763969 13738 hybrid_clock.cc:648] HybridClock initialized: now 1786165937763960 us; error 35 us; skew 500 ppm
Aug 08 05:12:17 dist-test-slave-bndk krb5kdc[13717](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165937, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:17.766379 13738 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:17.766793 13738 webserver.cc:460] Webserver started at http://127.12.251.62:43079/ using document root <none> and password file <none>
I20260808 05:12:17.767009 13738 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:17.767056 13738 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:17.767186 13738 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:17.768221 13738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "8ba700d26caa410da1c7b400cb736f15"
format_stamp: "Formatted at 2026-08-08 05:12:17 on dist-test-slave-bndk"
server_key: "49de666dd5377fd212849b3e9e2326e1"
server_key_iv: "1bd7cff92ff743a4d6e74f140c4f50f9"
server_key_version: "encryptionkey@0"
I20260808 05:12:17.768550 13738 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "8ba700d26caa410da1c7b400cb736f15"
format_stamp: "Formatted at 2026-08-08 05:12:17 on dist-test-slave-bndk"
server_key: "49de666dd5377fd212849b3e9e2326e1"
server_key_iv: "1bd7cff92ff743a4d6e74f140c4f50f9"
server_key_version: "encryptionkey@0"
I20260808 05:12:17.769838 13738 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:17.770494 13758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:17.770630 13738 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:17.770707 13738 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "8ba700d26caa410da1c7b400cb736f15"
format_stamp: "Formatted at 2026-08-08 05:12:17 on dist-test-slave-bndk"
server_key: "49de666dd5377fd212849b3e9e2326e1"
server_key_iv: "1bd7cff92ff743a4d6e74f140c4f50f9"
server_key_version: "encryptionkey@0"
I20260808 05:12:17.770771 13738 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:17.792491 13738 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:17.794351 13738 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:17.794538 13738 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:17.798503 13738 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:45753
I20260808 05:12:17.798555 13837 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:45753 every 8 connection(s)
I20260808 05:12:17.798862 13738 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:17.799742 13839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:17.802035 13839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15: Bootstrap starting.
I20260808 05:12:17.802570 13839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:17.802810 13839 log.cc:824] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:17.803457 13839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15: No bootstrap required, opened a new log
I20260808 05:12:17.804977 13839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba700d26caa410da1c7b400cb736f15" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45753 } }
I20260808 05:12:17.805116 13839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:17.805137 13839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ba700d26caa410da1c7b400cb736f15, State: Initialized, Role: FOLLOWER
I20260808 05:12:17.805290 13839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba700d26caa410da1c7b400cb736f15" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45753 } }
I20260808 05:12:17.805379 13839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:17.805398 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13738
I20260808 05:12:17.805418 13839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:17.805471 13839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:17.805509 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:17.805691 13292 external_mini_cluster.cc:1428] Setting key 63f44c47ff1d55f838aeb114b4090ccb
I20260808 05:12:17.806464 13839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba700d26caa410da1c7b400cb736f15" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45753 } }
I20260808 05:12:17.806555 13839 leader_election.cc:302] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ba700d26caa410da1c7b400cb736f15; no voters:
I20260808 05:12:17.806710 13839 leader_election.cc:288] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:17.806746 13846 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:17.806923 13846 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [term 1 LEADER]: Becoming Leader. State: Replica: 8ba700d26caa410da1c7b400cb736f15, State: Running, Role: LEADER
I20260808 05:12:17.807049 13839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:17.807047 13846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba700d26caa410da1c7b400cb736f15" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45753 } }
I20260808 05:12:17.807502 13849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ba700d26caa410da1c7b400cb736f15. Latest consensus state: current_term: 1 leader_uuid: "8ba700d26caa410da1c7b400cb736f15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba700d26caa410da1c7b400cb736f15" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45753 } } }
I20260808 05:12:17.807596 13849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:17.807752 13848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ba700d26caa410da1c7b400cb736f15" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ba700d26caa410da1c7b400cb736f15" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 45753 } } }
I20260808 05:12:17.807812 13848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:17.808260 13855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:17.808744 13855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:17.810685 13855 catalog_manager.cc:1347] Generated new cluster ID: bdb183172db64e00809eb975fc68800f
I20260808 05:12:17.810734 13855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 08 05:12:17 dist-test-slave-bndk krb5kdc[13717](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165937, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:12:17.817255 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:17.806183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36785 (local address 127.12.251.62:45753)
0808 05:12:17.806356 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:17.806366 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:17.806399 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:12:17.806517 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:17.806524 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:17.806583 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:17.806723 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:17.807540 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:17.808867 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:17.809899 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:17.810371 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:17.810477 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:17.813321 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:17.813325 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:17.813325 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:17.813336 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:17.815657 (+ 2321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:17.816062 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:17.816064 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:17.816065 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:17.816169 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:17.816359 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:17.816360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:17.816360 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:17.816635 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:17.816793 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:17.816900 (+ 107us) server_negotiation.cc:299] Negotiation successful
0808 05:12:17.817032 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
I20260808 05:12:17.818176 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:17.820726 13855 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:17.821192 13855 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:17.824967 13855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ba700d26caa410da1c7b400cb736f15: Generated new TSK 0
I20260808 05:12:17.825129 13855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:17.827659 13845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:17.819500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47909 (local address 127.12.251.62:45753)
0808 05:12:17.819530 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:17.819532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:17.821382 (+ 1850us) server_negotiation.cc:407] Connection header received
0808 05:12:17.821476 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:17.821477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:17.821487 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:17.821510 (+ 23us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:17.822117 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:17.822832 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:17.823851 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:17.824163 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:17.824198 (+ 35us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:17.825544 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:17.825545 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:17.825545 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:17.825552 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:17.826699 (+ 1147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:17.826991 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:17.826992 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:17.826992 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:17.827048 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:17.827211 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:17.827212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:17.827212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:17.827310 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:17.827390 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:17.827511 (+ 121us) server_negotiation.cc:299] Negotiation successful
0808 05:12:17.827580 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 05:12:17.829527 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13738
2026-08-08T05:12:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1406 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:17 dist-test-slave-bndk krb5kdc[13881](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:17 dist-test-slave-bndk krb5kdc[13881](info): set up 2 sockets
Aug 08 05:12:17 dist-test-slave-bndk krb5kdc[13881](info): commencing operation
krb5kdc: starting...
W20260808 05:12:18.962785 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:19 dist-test-slave-bndk krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165939, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:19.079391 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:35501
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:39553
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:35501
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:19.160020 13898 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:19.160259 13898 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:19.160290 13898 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:19.161418 13898 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:19.161456 13898 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:19.161476 13898 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:19.161491 13898 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:19.161506 13898 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:19.162926 13898 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:39553
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:35501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:35501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13898
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:19.163169 13898 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:19.163365 13898 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:19.167935 13903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:19.167902 13907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:19.167977 13898 server_base.cc:1034] running on GCE node
W20260808 05:12:19.167923 13904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:19.168319 13898 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:19.168588 13898 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:19.169724 13898 hybrid_clock.cc:648] HybridClock initialized: now 1786165939169704 us; error 31 us; skew 500 ppm
Aug 08 05:12:19 dist-test-slave-bndk krb5kdc[13881](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165939, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:19.175170 13898 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:19.175577 13898 webserver.cc:460] Webserver started at http://127.12.251.62:37807/ using document root <none> and password file <none>
I20260808 05:12:19.175778 13898 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:19.175825 13898 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:19.175956 13898 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:19.176970 13898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "ef5c61241ea841aea2e51b319a3f8dc7"
format_stamp: "Formatted at 2026-08-08 05:12:19 on dist-test-slave-bndk"
server_key: "ea5a5ca5867085c92b19075e9b176322"
server_key_iv: "f83032a1a273c3d3e54a64b9624ee6a4"
server_key_version: "encryptionkey@0"
I20260808 05:12:19.177341 13898 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "ef5c61241ea841aea2e51b319a3f8dc7"
format_stamp: "Formatted at 2026-08-08 05:12:19 on dist-test-slave-bndk"
server_key: "ea5a5ca5867085c92b19075e9b176322"
server_key_iv: "f83032a1a273c3d3e54a64b9624ee6a4"
server_key_version: "encryptionkey@0"
I20260808 05:12:19.178629 13898 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:12:19.179279 13915 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:19.179432 13898 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:12:19.179517 13898 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "ef5c61241ea841aea2e51b319a3f8dc7"
format_stamp: "Formatted at 2026-08-08 05:12:19 on dist-test-slave-bndk"
server_key: "ea5a5ca5867085c92b19075e9b176322"
server_key_iv: "f83032a1a273c3d3e54a64b9624ee6a4"
server_key_version: "encryptionkey@0"
I20260808 05:12:19.179582 13898 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:19.189736 13898 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:19.191339 13898 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:19.191466 13898 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:19.195243 13898 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:35501
I20260808 05:12:19.195274 14001 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:35501 every 8 connection(s)
I20260808 05:12:19.195573 13898 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:19.196352 14002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:19.198518 14002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7: Bootstrap starting.
I20260808 05:12:19.199052 14002 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:19.199275 14002 log.cc:824] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:19.199910 14002 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7: No bootstrap required, opened a new log
I20260808 05:12:19.201495 14002 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35501 } }
I20260808 05:12:19.201625 14002 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:19.201653 14002 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5c61241ea841aea2e51b319a3f8dc7, State: Initialized, Role: FOLLOWER
I20260808 05:12:19.201754 14002 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35501 } }
I20260808 05:12:19.201804 14002 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:19.201822 14002 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:19.201853 14002 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:19.202592 14002 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35501 } }
I20260808 05:12:19.202674 14002 leader_election.cc:302] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef5c61241ea841aea2e51b319a3f8dc7; no voters:
I20260808 05:12:19.202787 14002 leader_election.cc:288] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:19.202831 14005 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:19.202997 14002 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:19.203008 14005 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [term 1 LEADER]: Becoming Leader. State: Replica: ef5c61241ea841aea2e51b319a3f8dc7, State: Running, Role: LEADER
I20260808 05:12:19.203171 14005 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35501 } }
I20260808 05:12:19.203539 14006 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35501 } } }
I20260808 05:12:19.203743 14006 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:19.203681 14007 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef5c61241ea841aea2e51b319a3f8dc7. Latest consensus state: current_term: 1 leader_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef5c61241ea841aea2e51b319a3f8dc7" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 35501 } } }
I20260808 05:12:19.203954 14007 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:19.204062 14018 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:19.204176 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 13898
I20260808 05:12:19.204286 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:19.204470 13292 external_mini_cluster.cc:1428] Setting key c070768fac5aafe301332d74b13d4908
I20260808 05:12:19.204644 14018 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:19.206326 14018 catalog_manager.cc:1347] Generated new cluster ID: 4dd61a06e45349a39bfb7b044f8e469d
I20260808 05:12:19.206372 14018 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:19.210305 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:19.204912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:32949 (local address 127.12.251.62:35501)
0808 05:12:19.205329 (+ 417us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:19.205339 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:19.205372 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:12:19.205494 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:19.205501 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:19.205548 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:19.205664 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:19.205888 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:19.207207 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:19.208290 (+ 1083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:19.208909 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:19.209021 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:19.209656 (+ 635us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:19.209660 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:19.209660 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:19.209859 (+ 199us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:19.209898 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:19.209912 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:19.209980 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:19.210035 (+ 55us) server_negotiation.cc:299] Negotiation successful
0808 05:12:19.210098 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":77,"threads_started":1}
I20260808 05:12:19.211306 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:19.213860 14018 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:19.214308 14018 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:19.215907 14030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:19.212694 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57947 (local address 127.12.251.62:35501)
0808 05:12:19.212749 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:19.212751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:19.212956 (+ 205us) server_negotiation.cc:407] Connection header received
0808 05:12:19.213006 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:19.213007 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:19.213019 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:19.213046 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:19.213257 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:19.213700 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:19.214699 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:19.214991 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:19.215053 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:19.215686 (+ 633us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:19.215687 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:19.215688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:19.215693 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:19.215707 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:19.215711 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:19.215752 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:19.215801 (+ 49us) server_negotiation.cc:299] Negotiation successful
0808 05:12:19.215835 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:12:19.218503 14018 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef5c61241ea841aea2e51b319a3f8dc7: Generated new TSK 0
I20260808 05:12:19.218663 14018 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:19.222680 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 13898
2026-08-08T05:12:19Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1391 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:19 dist-test-slave-bndk krb5kdc[14043](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:19 dist-test-slave-bndk krb5kdc[14043](info): set up 2 sockets
Aug 08 05:12:19 dist-test-slave-bndk krb5kdc[14043](info): commencing operation
krb5kdc: starting...
W20260808 05:12:20.350337 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.099s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:20 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165940, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:20.476289 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:46361
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35595
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:46361
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:20.560036 14060 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:20.560240 14060 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:20.560272 14060 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:20.561420 14060 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:20.561461 14060 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:20.561482 14060 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:20.561497 14060 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:20.561527 14060 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:20.562983 14060 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35595
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:46361
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:46361
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14060
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:20.563221 14060 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:20.563421 14060 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:20.567929 14073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:20.567955 14075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:20.568044 14060 server_base.cc:1034] running on GCE node
W20260808 05:12:20.567986 14070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:20.568395 14060 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:20.568663 14060 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:20.569796 14060 hybrid_clock.cc:648] HybridClock initialized: now 1786165940569780 us; error 29 us; skew 500 ppm
Aug 08 05:12:20 dist-test-slave-bndk krb5kdc[14043](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165940, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:20.572099 14060 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:20.572530 14060 webserver.cc:460] Webserver started at http://127.12.251.62:35735/ using document root <none> and password file <none>
I20260808 05:12:20.572718 14060 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:20.572760 14060 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:20.572887 14060 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:20.573951 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "2a725426f21c4999a17b272100ec18a3"
format_stamp: "Formatted at 2026-08-08 05:12:20 on dist-test-slave-bndk"
server_key: "96e9e261a0769c6566f2017d5eec1909"
server_key_iv: "3b48e409aa9150f588b7c43197086a68"
server_key_version: "encryptionkey@0"
I20260808 05:12:20.574275 14060 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "2a725426f21c4999a17b272100ec18a3"
format_stamp: "Formatted at 2026-08-08 05:12:20 on dist-test-slave-bndk"
server_key: "96e9e261a0769c6566f2017d5eec1909"
server_key_iv: "3b48e409aa9150f588b7c43197086a68"
server_key_version: "encryptionkey@0"
I20260808 05:12:20.575479 14060 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:12:20.576151 14083 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:20.576402 14060 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260808 05:12:20.576483 14060 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "2a725426f21c4999a17b272100ec18a3"
format_stamp: "Formatted at 2026-08-08 05:12:20 on dist-test-slave-bndk"
server_key: "96e9e261a0769c6566f2017d5eec1909"
server_key_iv: "3b48e409aa9150f588b7c43197086a68"
server_key_version: "encryptionkey@0"
I20260808 05:12:20.576536 14060 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:20.579713 14060 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:20.581552 14060 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:20.581653 14060 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:20.585700 14060 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:46361
I20260808 05:12:20.585728 14155 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:46361 every 8 connection(s)
I20260808 05:12:20.586018 14060 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:20.586920 14156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:20.589066 14156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3: Bootstrap starting.
I20260808 05:12:20.589630 14156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:20.589875 14156 log.cc:824] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:20.590492 14156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3: No bootstrap required, opened a new log
I20260808 05:12:20.591831 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14060
I20260808 05:12:20.591951 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:20.592111 13292 external_mini_cluster.cc:1428] Setting key bcc3c84b8a5cb64f4cd82b5774c63323
I20260808 05:12:20.592132 14156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a725426f21c4999a17b272100ec18a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46361 } }
I20260808 05:12:20.592294 14156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260808 05:12:20.592339 14156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a725426f21c4999a17b272100ec18a3, State: Initialized, Role: FOLLOWER
I20260808 05:12:20.592478 14156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a725426f21c4999a17b272100ec18a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46361 } }
I20260808 05:12:20.592564 14156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260808 05:12:20.592603 14156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260808 05:12:20.592650 14156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:20.593667 14156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a725426f21c4999a17b272100ec18a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46361 } }
I20260808 05:12:20.593775 14156 leader_election.cc:302] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a725426f21c4999a17b272100ec18a3; no voters:
I20260808 05:12:20.593930 14156 leader_election.cc:288] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260808 05:12:20.593959 14165 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:20.594194 14156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:20.594200 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:20.592589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60973 (local address 127.12.251.62:46361)
0808 05:12:20.592781 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:20.592790 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:20.592830 (+ 40us) server_negotiation.cc:407] Connection header received
0808 05:12:20.592936 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:20.592942 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:20.592973 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:20.593087 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:20.593724 (+ 637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:20.593727 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:20.593728 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:20.593731 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:20.593784 (+ 53us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:20.593800 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:20.593870 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:20.593945 (+ 75us) server_negotiation.cc:299] Negotiation successful
0808 05:12:20.593994 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":86,"threads_started":1}
I20260808 05:12:20.594195 14165 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [term 1 LEADER]: Becoming Leader. State: Replica: 2a725426f21c4999a17b272100ec18a3, State: Running, Role: LEADER
I20260808 05:12:20.594504 14165 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a725426f21c4999a17b272100ec18a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46361 } }
I20260808 05:12:20.594882 14169 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a725426f21c4999a17b272100ec18a3. Latest consensus state: current_term: 1 leader_uuid: "2a725426f21c4999a17b272100ec18a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a725426f21c4999a17b272100ec18a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46361 } } }
I20260808 05:12:20.594965 14169 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:20.595177 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:20.595286 14167 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a725426f21c4999a17b272100ec18a3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a725426f21c4999a17b272100ec18a3" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 46361 } } }
I20260808 05:12:20.595342 14167 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:20.595628 14176 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:20.596196 14176 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:20.597957 14164 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:20.597056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54451 (local address 127.12.251.62:46361)
0808 05:12:20.597096 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:20.597098 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:20.597108 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:12:20.597164 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:20.597165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:20.597182 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:20.597275 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:20.597773 (+ 498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:20.597774 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:20.597774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0808 05:12:20.597779 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:20.597791 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0808 05:12:20.597795 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:20.597858 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:20.597890 (+ 32us) server_negotiation.cc:299] Negotiation successful
0808 05:12:20.597902 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:12:20.601656 14176 catalog_manager.cc:1347] Generated new cluster ID: 5155cd80b3084e87a65fb08590a75b4b
I20260808 05:12:20.601711 14176 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:20.611582 14176 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:20.611738 14176 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:20.618160 14176 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a725426f21c4999a17b272100ec18a3: Generated new TSK 0
I20260808 05:12:20.618326 14176 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:20.620697 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14060
2026-08-08T05:12:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1397 ms)
[----------] 18 tests from AuthTokenIssuingTest (25304 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:20 dist-test-slave-bndk krb5kdc[14196](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:20 dist-test-slave-bndk krb5kdc[14196](info): set up 2 sockets
Aug 08 05:12:20 dist-test-slave-bndk krb5kdc[14196](info): commencing operation
krb5kdc: starting...
W20260808 05:12:21.746023 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:21 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:21.859615 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44553
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:44553,127.12.251.61:35191,127.12.251.60:43021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:21.939478 14214 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:12:21.939682 14214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:21.939706 14214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:21.939730 14214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:21.940810 14214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:21.940846 14214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:21.940865 14214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:21.940881 14214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:21.940898 14214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:21.942375 14214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:44553,127.12.251.61:35191,127.12.251.60:43021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:44553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:21.942612 14214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:21.942814 14214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:21.947384 14223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:21.947474 14226 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:21.947373 14222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:21.947593 14214 server_base.cc:1034] running on GCE node
I20260808 05:12:21.947815 14214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:21.948076 14214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:21.949241 14214 hybrid_clock.cc:648] HybridClock initialized: now 1786165941949219 us; error 31 us; skew 500 ppm
Aug 08 05:12:21 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:21.951635 14214 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:21.952050 14214 webserver.cc:460] Webserver started at http://127.12.251.62:37837/ using document root <none> and password file <none>
I20260808 05:12:21.952242 14214 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:21.952291 14214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:21.952414 14214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:21.953460 14214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "e042568d2d58428c9942da6ce960f861"
format_stamp: "Formatted at 2026-08-08 05:12:21 on dist-test-slave-bndk"
server_key: "6c3a0c7316f74700bb26b9ee61d21f32"
server_key_iv: "ac89c099ac5269916d5b55ce6c597ff2"
server_key_version: "encryptionkey@0"
I20260808 05:12:21.953794 14214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "e042568d2d58428c9942da6ce960f861"
format_stamp: "Formatted at 2026-08-08 05:12:21 on dist-test-slave-bndk"
server_key: "6c3a0c7316f74700bb26b9ee61d21f32"
server_key_iv: "ac89c099ac5269916d5b55ce6c597ff2"
server_key_version: "encryptionkey@0"
I20260808 05:12:21.955130 14214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:12:21.955842 14238 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:21.956000 14214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:21.956086 14214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "e042568d2d58428c9942da6ce960f861"
format_stamp: "Formatted at 2026-08-08 05:12:21 on dist-test-slave-bndk"
server_key: "6c3a0c7316f74700bb26b9ee61d21f32"
server_key_iv: "ac89c099ac5269916d5b55ce6c597ff2"
server_key_version: "encryptionkey@0"
I20260808 05:12:21.956143 14214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:21.962991 14214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:21.964877 14214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:21.965003 14214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:21.968798 14214 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:44553
I20260808 05:12:21.968830 14314 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:44553 every 8 connection(s)
I20260808 05:12:21.969126 14214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:21.970081 14316 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:21.971527 14316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:21.974032 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14214
I20260808 05:12:21.974138 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:21.974277 13292 external_mini_cluster.cc:1428] Setting key 461026593cdd6d2a910c93c44bf83518
Aug 08 05:12:21 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:12:21.980791 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:21.972242 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59260 (local address 127.12.251.62:44553)
0808 05:12:21.972359 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:21.972364 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:21.972393 (+ 29us) server_negotiation.cc:407] Connection header received
0808 05:12:21.972801 (+ 408us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:21.972803 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:21.972819 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:21.972890 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:21.973400 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:21.974248 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:21.975358 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:21.975661 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:21.975737 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:21.977937 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:21.977945 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:21.977945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:21.977951 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:21.979363 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:21.979793 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:21.979795 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:21.979795 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:21.979864 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:21.980087 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:21.980087 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:21.980087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:21.980267 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:21.980321 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:21.980546 (+ 225us) server_negotiation.cc:299] Negotiation successful
0808 05:12:21.980638 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":42,"threads_started":1}
I20260808 05:12:21.980854 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:21.972088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:44553 (local address 127.0.0.1:59260)
0808 05:12:21.972233 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:21.972264 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:21.972685 (+ 421us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:21.972903 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:21.972905 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:21.973142 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:21.973329 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:21.973334 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:21.974333 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:21.974334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:21.975277 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:21.975280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:21.975761 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:21.975762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:21.975833 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:21.976349 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:21.976357 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:21.977854 (+ 1497us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:21.979451 (+ 1597us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:21.979459 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:21.979462 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:21.979719 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:21.979919 (+ 200us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:21.979920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:21.979920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:21.980028 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:21.980323 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:21.980329 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:21.980407 (+ 78us) client_negotiation.cc:769] Sending connection context
0808 05:12:21.980512 (+ 105us) client_negotiation.cc:240] Negotiation successful
0808 05:12:21.980726 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":63,"thread_start_us":72,"threads_started":1}
I20260808 05:12:21.981536 14316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:21.981902 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:21.981780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:47942)
0808 05:12:21.981832 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:21.981879 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260808 05:12:21.982074 14240 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
I20260808 05:12:21.982467 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:21.982361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:47952)
0808 05:12:21.982406 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:21.982444 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 05:12:21.982570 14316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:35191: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.251.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab.
Entry for principal kudu/127.12.251.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab.
I20260808 05:12:21.999289 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:35191
--webserver_interface=127.12.251.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab
--principal=kudu/127.12.251.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:44553,127.12.251.61:35191,127.12.251.60:43021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:12:22.031797 14316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } attempt: 1
I20260808 05:12:22.032290 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.032159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:47954)
0808 05:12:22.032224 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.032263 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260808 05:12:22.032629 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.032547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:47970)
0808 05:12:22.032585 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.032609 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260808 05:12:22.032716 14316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:35191: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
W20260808 05:12:22.080147 14324 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:12:22.080340 14324 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:22.080355 14324 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:22.080374 14324 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:22.081465 14324 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:22.081501 14324 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:22.081514 14324 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:22.081525 14324 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:22.081537 14324 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:22.082949 14324 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:44553,127.12.251.61:35191,127.12.251.60:43021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab
--principal=kudu/127.12.251.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:35191
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.251.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:22.083125 14324 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:22.083297 14324 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:22.087992 14335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:22.087958 14332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:22.087999 14324 server_base.cc:1034] running on GCE node
W20260808 05:12:22.087968 14330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:22.088466 14324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:22.088742 14324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:22.089890 14324 hybrid_clock.cc:648] HybridClock initialized: now 1786165942089876 us; error 31 us; skew 500 ppm
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:22.092248 14324 init.cc:377] Logged in from keytab as kudu/127.12.251.61@KRBTEST.COM (short username kudu)
I20260808 05:12:22.092669 14324 webserver.cc:460] Webserver started at http://127.12.251.61:34529/ using document root <none> and password file <none>
I20260808 05:12:22.092881 14324 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:22.092948 14324 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:22.093070 14324 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:22.094152 14324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data/instance:
uuid: "4ed02fe9fcf5405e9fe337cf1b80341f"
format_stamp: "Formatted at 2026-08-08 05:12:22 on dist-test-slave-bndk"
server_key: "c7cb5f433f665153dd60c3ad85ffe178"
server_key_iv: "98fc094b147f5642a8e01412a56be8b8"
server_key_version: "encryptionkey@0"
I20260808 05:12:22.094484 14324 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/wal/instance:
uuid: "4ed02fe9fcf5405e9fe337cf1b80341f"
format_stamp: "Formatted at 2026-08-08 05:12:22 on dist-test-slave-bndk"
server_key: "c7cb5f433f665153dd60c3ad85ffe178"
server_key_iv: "98fc094b147f5642a8e01412a56be8b8"
server_key_version: "encryptionkey@0"
I20260808 05:12:22.095703 14324 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260808 05:12:22.096361 14347 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:22.096508 14324 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:22.096590 14324 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/wal
uuid: "4ed02fe9fcf5405e9fe337cf1b80341f"
format_stamp: "Formatted at 2026-08-08 05:12:22 on dist-test-slave-bndk"
server_key: "c7cb5f433f665153dd60c3ad85ffe178"
server_key_iv: "98fc094b147f5642a8e01412a56be8b8"
server_key_version: "encryptionkey@0"
I20260808 05:12:22.096654 14324 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:22.100872 14316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } attempt: 2
I20260808 05:12:22.101210 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.101106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:47980)
0808 05:12:22.101155 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.101183 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 05:12:22.101548 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.101469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:47982)
0808 05:12:22.101502 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.101525 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 05:12:22.101643 14316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:35191: Network error: Client connection negotiation failed: client connection to 127.12.251.61:35191: connect: Connection refused (error 111)
I20260808 05:12:22.103575 14324 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:22.105155 14324 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:22.105298 14324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:22.108986 14324 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.61:35191
I20260808 05:12:22.109021 14428 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.61:35191 every 8 connection(s)
I20260808 05:12:22.109368 14324 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
I20260808 05:12:22.110278 14429 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:22.111723 14429 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:22.114063 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14324
I20260808 05:12:22.114152 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-1/wal/instance
I20260808 05:12:22.114300 13292 external_mini_cluster.cc:1428] Setting key ede17569154c7b79f74ae987afd5cb52
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:12:22.120107 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.112345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59270 (local address 127.12.251.62:44553)
0808 05:12:22.112403 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.112405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.112601 (+ 196us) server_negotiation.cc:407] Connection header received
0808 05:12:22.113016 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.113017 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.113025 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.113077 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.113659 (+ 582us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.114132 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.115115 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.115383 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.115451 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.117648 (+ 2197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.117650 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.117650 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.117656 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.118884 (+ 1228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.119244 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.119245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.119245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.119298 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.119508 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.119509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.119510 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.119619 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.119675 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.119927 (+ 252us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.120018 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260808 05:12:22.120240 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.112305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:44553 (local address 127.0.0.1:59270)
0808 05:12:22.112478 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.112517 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.112945 (+ 428us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.113126 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.113129 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.113404 (+ 275us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.113591 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.113596 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.114233 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.114234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.115031 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.115034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.115500 (+ 466us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.115501 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.115592 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.116060 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.116070 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.117558 (+ 1488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.118958 (+ 1400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.118966 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.118968 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.119179 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.119351 (+ 172us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.119352 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.119352 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.119453 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.119676 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.119684 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.119814 (+ 130us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.119898 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.120040 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260808 05:12:22.120674 14429 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.251.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.60@KRBTEST.COM" created.
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:22.127810 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.120884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:47998)
0808 05:12:22.120936 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.120947 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.120993 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.121176 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.121177 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.121334 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.121392 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.121394 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.122228 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.122229 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.122726 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.122728 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.123199 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.123200 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.123250 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.123549 (+ 299us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.123553 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.125285 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.126836 (+ 1551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.126837 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.126837 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.127034 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.127202 (+ 168us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.127203 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.127203 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.127266 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.127584 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.127585 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.127621 (+ 36us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.127670 (+ 49us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.127747 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:12:22.127919 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.120919 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47998 (local address 127.12.251.61:35191)
0808 05:12:22.121048 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.121052 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.121070 (+ 18us) server_negotiation.cc:407] Connection header received
0808 05:12:22.121091 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.121092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.121103 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.121158 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.121469 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.122149 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.122786 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.123141 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.123195 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.125364 (+ 2169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.125373 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.125374 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.125381 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.126757 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.127102 (+ 345us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.127104 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.127104 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.127150 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.127321 (+ 171us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.127322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.127322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.127509 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.127603 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.127706 (+ 103us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.127826 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":24,"server-negotiator.queue_time_us":103,"thread_start_us":65,"threads_started":1}
I20260808 05:12:22.128494 14429 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:22.128808 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.128683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40838)
0808 05:12:22.128729 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.128784 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 05:12:22.128943 14348 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
I20260808 05:12:22.129367 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.129277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40854)
0808 05:12:22.129317 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.129345 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260808 05:12:22.129469 14429 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:43021: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab.
Entry for principal kudu/127.12.251.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab.
I20260808 05:12:22.139405 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:43021
--webserver_interface=127.12.251.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab
--principal=kudu/127.12.251.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:42609
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:44553,127.12.251.61:35191,127.12.251.60:43021
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:12:22.178690 14429 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } attempt: 1
I20260808 05:12:22.179230 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.179087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40866)
0808 05:12:22.179149 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.179196 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260808 05:12:22.179572 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.179480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40876)
0808 05:12:22.179523 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.179552 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260808 05:12:22.179669 14429 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:43021: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
I20260808 05:12:22.192780 14316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } attempt: 3
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:22.199885 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.193117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:48000)
0808 05:12:22.193176 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.193189 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.193270 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.193420 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.193421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.193577 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.193643 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.193645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.194646 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.194647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.195194 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.195196 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.195675 (+ 479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.195676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.195725 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.196163 (+ 438us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.196167 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.197357 (+ 1190us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.199027 (+ 1670us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.199027 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.199028 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.199188 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.199366 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.199366 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.199366 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.199417 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.199635 (+ 218us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.199636 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.199681 (+ 45us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.199744 (+ 63us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.199816 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260808 05:12:22.199955 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.193166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48000 (local address 127.12.251.61:35191)
0808 05:12:22.193248 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.193250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.193263 (+ 13us) server_negotiation.cc:407] Connection header received
0808 05:12:22.193332 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.193333 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.193348 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.193403 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.193706 (+ 303us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.194569 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.195269 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.195609 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.195682 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.197447 (+ 1765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.197449 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.197450 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.197458 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.198902 (+ 1444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.199248 (+ 346us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.199249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.199249 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.199310 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.199462 (+ 152us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.199463 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.199463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.199585 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.199646 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.199776 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.199854 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260808 05:12:22.200239 14316 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:22.200541 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.200448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40888)
0808 05:12:22.200487 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.200520 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260808 05:12:22.200799 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.200729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40904)
0808 05:12:22.200760 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.200780 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 05:12:22.200868 14316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:43021: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
W20260808 05:12:22.221540 14436 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:12:22.221742 14436 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:22.221764 14436 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:22.221791 14436 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:22.222885 14436 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:22.222925 14436 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:22.222944 14436 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:22.222959 14436 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:22.222975 14436 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:22.224438 14436 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:42609
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:44553,127.12.251.61:35191,127.12.251.60:43021
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab
--principal=kudu/127.12.251.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:43021
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.251.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14436
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:22.224674 14436 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:22.224869 14436 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:22.229382 14443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:22.229434 14445 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:22.229547 14436 server_base.cc:1034] running on GCE node
W20260808 05:12:22.229380 14449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:22.229877 14436 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:22.230150 14436 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:22.231288 14436 hybrid_clock.cc:648] HybridClock initialized: now 1786165942231269 us; error 34 us; skew 500 ppm
I20260808 05:12:22.231993 14316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } attempt: 1
I20260808 05:12:22.232357 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.232236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40918)
0808 05:12:22.232292 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.232326 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260808 05:12:22.232649 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.232580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40922)
0808 05:12:22.232611 (+ 31us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.232633 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
W20260808 05:12:22.232731 14316 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:43021: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:22.233850 14436 init.cc:377] Logged in from keytab as kudu/127.12.251.60@KRBTEST.COM (short username kudu)
I20260808 05:12:22.234251 14436 webserver.cc:460] Webserver started at http://127.12.251.60:45671/ using document root <none> and password file <none>
I20260808 05:12:22.234441 14436 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:22.234488 14436 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:22.234611 14436 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:22.235598 14436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data/instance:
uuid: "6afb39a8ae5a4fb2901af26835b4b444"
format_stamp: "Formatted at 2026-08-08 05:12:22 on dist-test-slave-bndk"
server_key: "f5487a10b6bc9435c7cb38bd6587050a"
server_key_iv: "bc6d89826765ff9d3228bbe82b20b563"
server_key_version: "encryptionkey@0"
I20260808 05:12:22.235918 14436 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/wal/instance:
uuid: "6afb39a8ae5a4fb2901af26835b4b444"
format_stamp: "Formatted at 2026-08-08 05:12:22 on dist-test-slave-bndk"
server_key: "f5487a10b6bc9435c7cb38bd6587050a"
server_key_iv: "bc6d89826765ff9d3228bbe82b20b563"
server_key_version: "encryptionkey@0"
I20260808 05:12:22.237109 14436 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260808 05:12:22.237783 14458 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:22.237921 14436 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:22.238000 14436 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/wal
uuid: "6afb39a8ae5a4fb2901af26835b4b444"
format_stamp: "Formatted at 2026-08-08 05:12:22 on dist-test-slave-bndk"
server_key: "f5487a10b6bc9435c7cb38bd6587050a"
server_key_iv: "bc6d89826765ff9d3228bbe82b20b563"
server_key_version: "encryptionkey@0"
I20260808 05:12:22.238066 14436 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:22.247815 14429 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } attempt: 2
I20260808 05:12:22.248195 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.248093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40938)
0808 05:12:22.248142 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.248168 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260808 05:12:22.248497 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.248421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40940)
0808 05:12:22.248457 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.248481 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 05:12:22.248570 14429 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:43021: Network error: Client connection negotiation failed: client connection to 127.12.251.60:43021: connect: Connection refused (error 111)
I20260808 05:12:22.258741 14436 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:22.260542 14436 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:22.260665 14436 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:22.264433 14436 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.60:43021
I20260808 05:12:22.264463 14535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.60:43021 every 8 connection(s)
I20260808 05:12:22.264775 14436 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
I20260808 05:12:22.265762 14536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:22.267227 14536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:12:22.273756 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14436
I20260808 05:12:22.273855 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786165676707025-13292-0/minicluster-data/master-2/wal/instance
I20260808 05:12:22.274034 13292 external_mini_cluster.cc:1428] Setting key df62503a9c96be1fede112974fad2f20
I20260808 05:12:22.275380 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.267909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59280 (local address 127.12.251.62:44553)
0808 05:12:22.267975 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.267977 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.268136 (+ 159us) server_negotiation.cc:407] Connection header received
0808 05:12:22.268605 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.268607 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.268619 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.268672 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.269285 (+ 613us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.269748 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.270663 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.270845 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.270899 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.272777 (+ 1878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.272778 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.272779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.272785 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.274030 (+ 1245us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.274492 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.274493 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.274493 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.274559 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.274784 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.274785 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.274785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.274895 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.274950 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.275212 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.275292 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260808 05:12:22.275520 14538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.267820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:44553 (local address 127.0.0.1:59280)
0808 05:12:22.268022 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.268063 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.268513 (+ 450us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.268755 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.268759 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.268989 (+ 230us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.269194 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.269198 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.269824 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.269825 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.270585 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.270587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.270932 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.270933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.271046 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.271424 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.271431 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.272694 (+ 1263us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.274105 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.274113 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.274115 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.274399 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.274622 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.274623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.274624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.274727 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.274950 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.274956 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.275096 (+ 140us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.275180 (+ 84us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.275322 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":85,"threads_started":1}
I20260808 05:12:22.276050 14536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:22.282338 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.274411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40956 (local address 127.12.251.60:43021)
0808 05:12:22.274597 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.274602 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.274625 (+ 23us) server_negotiation.cc:407] Connection header received
0808 05:12:22.274689 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.274692 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.274704 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.274762 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.275348 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.276323 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.277156 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.277557 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.277608 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.279868 (+ 2260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.279876 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.279876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.279883 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.281271 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.281581 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.281584 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.281584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.281662 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.281827 (+ 165us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.281828 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.281828 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.281961 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.282081 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.282165 (+ 84us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.282240 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":71,"threads_started":1}
I20260808 05:12:22.282438 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.276338 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48014 (local address 127.12.251.61:35191)
0808 05:12:22.276380 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.276382 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.276391 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:12:22.276415 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.276416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.276425 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.276465 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.276713 (+ 248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.277199 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.277912 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.278189 (+ 277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.278237 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.280234 (+ 1997us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.280235 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.280236 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.280242 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.281499 (+ 1257us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.281792 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.281793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.281794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.281846 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.282001 (+ 155us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.282002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.282002 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.282108 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.282160 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.282290 (+ 130us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.282353 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:12:22.282438 14538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.276272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:35191 (local address 127.0.0.1:48014)
0808 05:12:22.276310 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.276321 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.276360 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.276471 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.276471 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.276606 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.276653 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.276654 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.277280 (+ 626us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.277281 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.277835 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.277838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.278254 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.278255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.278323 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.278603 (+ 280us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.278608 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.280158 (+ 1550us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.281571 (+ 1413us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.281572 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.281572 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.281735 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.281897 (+ 162us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.281898 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.281898 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.281953 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.282162 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.282162 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.282202 (+ 40us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.282262 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.282347 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":25}
I20260808 05:12:22.282831 14536 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:12:22.288655 14538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.283068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40966)
0808 05:12:22.283101 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.283110 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.283141 (+ 31us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.283252 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.283253 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.283376 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.283399 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.283401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.284087 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.284088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.284700 (+ 612us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.284702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.285095 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.285095 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.285142 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.285470 (+ 328us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.285475 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.286528 (+ 1053us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.287858 (+ 1330us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.287859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.287860 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.288026 (+ 166us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.288205 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.288206 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.288206 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.288248 (+ 42us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.288468 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.288469 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.288498 (+ 29us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.288539 (+ 41us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.288602 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260808 05:12:22.288751 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.283141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40966 (local address 127.12.251.60:43021)
0808 05:12:22.283170 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.283171 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.283178 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:12:22.283195 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.283196 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.283204 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.283249 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.283466 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.284022 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.284770 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.285039 (+ 269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.285084 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.286604 (+ 1520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.286605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.286605 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.286612 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.287793 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.288090 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.288091 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.288091 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.288144 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.288294 (+ 150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.288295 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.288295 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.288411 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.288477 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.288563 (+ 86us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.288656 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":15}
I20260808 05:12:22.289592 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.283102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59292 (local address 127.12.251.62:44553)
0808 05:12:22.283142 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.283144 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.283152 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:12:22.283216 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.283217 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.283225 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.283262 (+ 37us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.283767 (+ 505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.284277 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.284935 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.285134 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.285199 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.287145 (+ 1946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.287146 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.287146 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.287152 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.288547 (+ 1395us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.288877 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.288878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.288879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.288929 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.289125 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.289127 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.289127 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.289278 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.289398 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.289475 (+ 77us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.289533 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:12:22.290055 14536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: Bootstrap starting.
I20260808 05:12:22.290978 14536 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:22.291278 14536 log.cc:824] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:22.292066 14536 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: No bootstrap required, opened a new log
I20260808 05:12:22.293989 14536 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
I20260808 05:12:22.294142 14536 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6afb39a8ae5a4fb2901af26835b4b444, State: Initialized, Role: FOLLOWER
I20260808 05:12:22.294205 14536 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:22.294507 14536 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:22.294457 14543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.294564 14543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:12:22.296134 14556 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:12:22.296231 14556 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:12:22.297330 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.290426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48026 (local address 127.12.251.61:35191)
0808 05:12:22.290458 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.290460 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.290467 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:12:22.290485 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.290486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.290494 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.290538 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.291039 (+ 501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.291574 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.292354 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.292561 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.292612 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.294900 (+ 2288us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.294902 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.294902 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.294909 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.296382 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.296662 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.296663 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.296663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.296715 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.296872 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.296873 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.296873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.296972 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.297117 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.297151 (+ 34us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.297247 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260808 05:12:22.296394 14436 master_runner.cc:186] Error getting master registration for 127.12.251.62:44553: OK, instance_id { permanent_uuid: "e042568d2d58428c9942da6ce960f861" instance_seqno: 1786165941967756 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:12:22.298527 14436 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:12:22.298558 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:22.299582 14274 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "e042568d2d58428c9942da6ce960f861"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59292
I20260808 05:12:22.307894 14316 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } attempt: 2
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165941, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:12:22.314782 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.308233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40968 (local address 127.12.251.60:43021)
0808 05:12:22.308278 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.308280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.308291 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:12:22.308311 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.308312 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.308321 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.308368 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.308674 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.309411 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.310356 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.310647 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.310700 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.312598 (+ 1898us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.312599 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.312600 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.312606 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.313807 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.314108 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.314109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.314110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.314157 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.314315 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.314316 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.314316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.314433 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.314488 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.314632 (+ 144us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.314697 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:12:22.314783 14318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.308161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40968)
0808 05:12:22.308213 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.308223 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.308257 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.308387 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.308387 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.308557 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.308603 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.308605 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.309481 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.309482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.310285 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.310288 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.310705 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.310706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.310763 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.311095 (+ 332us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.311099 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.312513 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.313882 (+ 1369us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.313883 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.313883 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.314050 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.314209 (+ 159us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.314210 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.314210 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.314266 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.314493 (+ 227us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.314494 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.314546 (+ 52us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.314603 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.314691 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260808 05:12:22.315945 14316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861: Bootstrap starting.
I20260808 05:12:22.316529 14316 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:22.316773 14316 log.cc:824] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:22.317492 14316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861: No bootstrap required, opened a new log
I20260808 05:12:22.318456 14316 raft_consensus.cc:348] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
I20260808 05:12:22.318565 14316 raft_consensus.cc:729] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e042568d2d58428c9942da6ce960f861, State: Initialized, Role: FOLLOWER
I20260808 05:12:22.318641 14316 consensus_queue.cc:260] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
I20260808 05:12:22.318944 14316 sys_catalog.cc:564] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:22.318902 14562 sys_catalog.cc:455] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.319002 14562 sys_catalog.cc:458] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:22.319082 14274 raft_consensus.cc:482] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 05:12:22.319167 14274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:22.319942 14274 raft_consensus.cc:504] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
W20260808 05:12:22.320953 14579 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:12:22.321048 14579 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:12:22.321480 14498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e042568d2d58428c9942da6ce960f861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6afb39a8ae5a4fb2901af26835b4b444"
I20260808 05:12:22.321609 14498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:22.322502 14498 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e042568d2d58428c9942da6ce960f861 in term 1.
I20260808 05:12:22.322753 14239 leader_election.cc:302] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6afb39a8ae5a4fb2901af26835b4b444, e042568d2d58428c9942da6ce960f861; no voters:
I20260808 05:12:22.322873 14274 leader_election.cc:288] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [CANDIDATE]: Term 1 election: Requested vote from peers 4ed02fe9fcf5405e9fe337cf1b80341f (127.12.251.61:35191), 6afb39a8ae5a4fb2901af26835b4b444 (127.12.251.60:43021)
I20260808 05:12:22.321645 14214 master_runner.cc:186] Error getting master registration for 127.12.251.61:35191: OK, instance_id { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" instance_seqno: 1786165942107961 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:12:22.324018 14214 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:12:22.324097 14562 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:22.324247 14562 raft_consensus.cc:686] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [term 1 LEADER]: Becoming Leader. State: Replica: e042568d2d58428c9942da6ce960f861, State: Running, Role: LEADER
I20260808 05:12:22.324394 14562 consensus_queue.cc:237] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
I20260808 05:12:22.324823 14562 sys_catalog.cc:455] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e042568d2d58428c9942da6ce960f861. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.324905 14562 sys_catalog.cc:458] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:22.325402 14589 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:22.325639 14589 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:22.334062 14433 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.324276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48032 (local address 127.12.251.61:35191)
0808 05:12:22.324318 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.324320 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.325454 (+ 1134us) server_negotiation.cc:407] Connection header received
0808 05:12:22.325583 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.325584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.325595 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.325625 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.327090 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.327828 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.328877 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.329198 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.329270 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.330815 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.330817 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.330817 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.330824 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.332789 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.333170 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.333171 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.333172 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.333259 (+ 87us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.333473 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.333474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.333474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.333614 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.333683 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.333883 (+ 200us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.333963 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:12:22.336374 14320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.325050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59306 (local address 127.12.251.62:44553)
0808 05:12:22.325085 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.325087 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.326813 (+ 1726us) server_negotiation.cc:407] Connection header received
0808 05:12:22.326968 (+ 155us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.326969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.326979 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.327047 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.328025 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.328713 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.330239 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.330545 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.330586 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.333028 (+ 2442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.333030 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.333030 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.333038 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.334744 (+ 1706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.335321 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.335322 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.335323 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.335393 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.335681 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.335682 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.335683 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.335828 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.335905 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.336211 (+ 306us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.336284 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:12:22.338088 14498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [term 1 FOLLOWER]: Refusing update from remote peer e042568d2d58428c9942da6ce960f861: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:12:22.338476 14585 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:12:22.339694 14429 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } attempt: 3
I20260808 05:12:22.339869 14543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e042568d2d58428c9942da6ce960f861. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.339948 14543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:22.343791 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.325056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40974 (local address 127.12.251.60:43021)
0808 05:12:22.325102 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.325104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.335044 (+ 9940us) server_negotiation.cc:407] Connection header received
0808 05:12:22.335133 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.335134 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.335144 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.335171 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.335696 (+ 525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.336420 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.337517 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.337823 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.337885 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.341014 (+ 3129us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.341015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.341015 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.341022 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.342600 (+ 1578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.342970 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.342972 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.342972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.343028 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.343211 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.343212 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.343212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.343340 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.343420 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.343625 (+ 205us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.343699 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:12:22.347200 14562 sys_catalog.cc:455] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.347290 14562 sys_catalog.cc:458] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:22.347434 14543 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.347513 14543 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:22.347820 14595 mvcc.cc:205] Tried to move back new op lower bound from 7316135699814498304 to 7316135699761508352. Current Snapshot: MvccSnapshot[applied={T|T < 7316135699814498304}]
Aug 08 05:12:22 dist-test-slave-bndk krb5kdc[14196](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165942, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:12:22.351922 14431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.339926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:43021 (local address 127.0.0.1:40980)
0808 05:12:22.340002 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:22.340011 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:22.340062 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:22.343983 (+ 3921us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:22.343985 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:22.344141 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:22.344199 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.344201 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.345312 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.345313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.346133 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:22.346136 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.346665 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.346667 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:22.346741 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.347205 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:22.347210 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:22.348637 (+ 1427us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:22.350685 (+ 2048us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.350687 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.350687 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.350923 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.351124 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:22.351125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:22.351125 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:22.351184 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:22.351586 (+ 402us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:22.351587 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:22.351637 (+ 50us) client_negotiation.cc:769] Sending connection context
0808 05:12:22.351698 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:12:22.351821 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260808 05:12:22.352329 14539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:22.340137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40980 (local address 127.12.251.60:43021)
0808 05:12:22.343868 (+ 3731us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.343870 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.343877 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:12:22.343894 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.343895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.343904 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.343958 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.344477 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.345202 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.346237 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:22.346540 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:22.346598 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:22.348724 (+ 2126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:22.348725 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:22.348726 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:22.348732 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:22.350385 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.351004 (+ 619us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.351005 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.351006 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.351061 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:22.351243 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:22.351244 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:22.351245 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:22.351500 (+ 255us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:22.351579 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:22.352147 (+ 568us) server_negotiation.cc:299] Negotiation successful
0808 05:12:22.352240 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3718,"thread_start_us":69,"threads_started":1}
I20260808 05:12:22.353804 14429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: Bootstrap starting.
I20260808 05:12:22.354607 14429 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:22.354897 14429 log.cc:824] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:22.355247 14589 catalog_manager.cc:1347] Generated new cluster ID: baa12501f18643fea63b98febc797920
I20260808 05:12:22.355293 14589 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:22.357753 14429 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: No bootstrap required, opened a new log
I20260808 05:12:22.359747 14429 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
I20260808 05:12:22.359885 14429 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ed02fe9fcf5405e9fe337cf1b80341f, State: Initialized, Role: FOLLOWER
I20260808 05:12:22.359956 14429 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } }
I20260808 05:12:22.360268 14429 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:22.361317 14391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e042568d2d58428c9942da6ce960f861" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f"
I20260808 05:12:22.361428 14391 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:22.362250 14391 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e042568d2d58428c9942da6ce960f861 in term 1.
I20260808 05:12:22.362644 14390 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [term 1 FOLLOWER]: Refusing update from remote peer e042568d2d58428c9942da6ce960f861: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:12:22.362960 14585 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:12:22.365288 14605 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.365414 14624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.365481 14624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:22.365404 14605 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:22.365559 14633 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [sys.catalog]: SysCatalogTable state changed. Reason: New leader e042568d2d58428c9942da6ce960f861. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.365686 14633 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:22.373962 14623 catalog_manager.cc:1259] Loaded cluster ID: baa12501f18643fea63b98febc797920
I20260808 05:12:22.374061 14623 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: loading cluster ID for follower catalog manager: success
W20260808 05:12:22.374197 14623 catalog_manager.cc:1576] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: acquiring CA information for follower catalog manager: Not found: root CA entry not found
W20260808 05:12:22.374266 14623 catalog_manager.cc:873] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:12:22.376977 14585 sys_catalog.cc:455] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e042568d2d58428c9942da6ce960f861" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e042568d2d58428c9942da6ce960f861" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 44553 } } peers { permanent_uuid: "4ed02fe9fcf5405e9fe337cf1b80341f" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 35191 } } peers { permanent_uuid: "6afb39a8ae5a4fb2901af26835b4b444" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 43021 } } }
I20260808 05:12:22.377086 14585 sys_catalog.cc:458] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:22.378496 14589 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:22.379200 14589 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:22.388512 14589 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e042568d2d58428c9942da6ce960f861: Generated new TSK 0
I20260808 05:12:22.388731 14589 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260808 05:12:22.411945 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.410386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48036 (local address 127.12.251.61:35191)
0808 05:12:22.410430 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.410432 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.411272 (+ 840us) server_negotiation.cc:407] Connection header received
0808 05:12:22.411408 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.411409 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.411420 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.411447 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.411877 (+ 430us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48036: BlockingRecv error: recv got EOF from 127.0.0.1:48036 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:12:22.412758 14320 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.410728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59308 (local address 127.12.251.62:44553)
0808 05:12:22.410764 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.410766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.412273 (+ 1507us) server_negotiation.cc:407] Connection header received
0808 05:12:22.412380 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.412381 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.412392 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.412418 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.412703 (+ 285us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59308: BlockingRecv error: recv got EOF from 127.0.0.1:59308 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 05:12:22.413558 14539 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.411010 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40982 (local address 127.12.251.60:43021)
0808 05:12:22.411049 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.411051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.413049 (+ 1998us) server_negotiation.cc:407] Connection header received
0808 05:12:22.413140 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.413141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.413151 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.413177 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.413501 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40982: BlockingRecv error: recv got EOF from 127.0.0.1:40982 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260808 05:12:22.418642 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.417839 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48040 (local address 127.12.251.61:35191)
0808 05:12:22.417872 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.417874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.418097 (+ 223us) server_negotiation.cc:407] Connection header received
0808 05:12:22.418200 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.418201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.418220 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.418248 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.418597 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48040: BlockingRecv error: recv got EOF from 127.0.0.1:48040 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 05:12:22.421824 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.421018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48052 (local address 127.12.251.61:35191)
0808 05:12:22.421049 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.421050 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.421326 (+ 276us) server_negotiation.cc:407] Connection header received
0808 05:12:22.421435 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.421436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.421446 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.421473 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.421786 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48052: BlockingRecv error: recv got EOF from 127.0.0.1:48052 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 05:12:22.425799 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.425027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48064 (local address 127.12.251.61:35191)
0808 05:12:22.425068 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.425069 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.425318 (+ 249us) server_negotiation.cc:407] Connection header received
0808 05:12:22.425428 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.425429 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.425439 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.425466 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.425761 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48064: BlockingRecv error: recv got EOF from 127.0.0.1:48064 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 05:12:22.431720 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.430924 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48072 (local address 127.12.251.61:35191)
0808 05:12:22.430956 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.430958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.431195 (+ 237us) server_negotiation.cc:407] Connection header received
0808 05:12:22.431289 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.431290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.431319 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.431358 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.431677 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48072: BlockingRecv error: recv got EOF from 127.0.0.1:48072 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 05:12:22.441694 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.440905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48080 (local address 127.12.251.61:35191)
0808 05:12:22.440939 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.440940 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.441167 (+ 227us) server_negotiation.cc:407] Connection header received
0808 05:12:22.441289 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.441290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.441301 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.441339 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.441649 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48080: BlockingRecv error: recv got EOF from 127.0.0.1:48080 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260808 05:12:22.460119 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.459149 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48090 (local address 127.12.251.61:35191)
0808 05:12:22.459192 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.459194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.459493 (+ 299us) server_negotiation.cc:407] Connection header received
0808 05:12:22.459601 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.459602 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.459614 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.459644 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.460059 (+ 415us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48090: BlockingRecv error: recv got EOF from 127.0.0.1:48090 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:12:22.494334 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.493603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48102 (local address 127.12.251.61:35191)
0808 05:12:22.493660 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.493662 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.493800 (+ 138us) server_negotiation.cc:407] Connection header received
0808 05:12:22.493839 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.493840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.493854 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.493927 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.494241 (+ 314us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48102: BlockingRecv error: recv got EOF from 127.0.0.1:48102 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 05:12:22.560072 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.559396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48118 (local address 127.12.251.61:35191)
0808 05:12:22.559462 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.559464 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.559569 (+ 105us) server_negotiation.cc:407] Connection header received
0808 05:12:22.559618 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.559619 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.559629 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.559695 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.559994 (+ 299us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48118: BlockingRecv error: recv got EOF from 127.0.0.1:48118 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
W20260808 05:12:22.689843 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.689155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48126 (local address 127.12.251.61:35191)
0808 05:12:22.689231 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.689233 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.689344 (+ 111us) server_negotiation.cc:407] Connection header received
0808 05:12:22.689397 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.689398 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.689408 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.689465 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.689781 (+ 316us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48126: BlockingRecv error: recv got EOF from 127.0.0.1:48126 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
W20260808 05:12:22.947628 14433 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:22.946957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48130 (local address 127.12.251.61:35191)
0808 05:12:22.947040 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:22.947043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:22.947076 (+ 33us) server_negotiation.cc:407] Connection header received
0808 05:12:22.947158 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:22.947159 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:22.947172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:22.947219 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:22.947566 (+ 347us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48130: BlockingRecv error: recv got EOF from 127.0.0.1:48130 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
I20260808 05:12:23.296728 14556 catalog_manager.cc:1259] Loaded cluster ID: baa12501f18643fea63b98febc797920
I20260808 05:12:23.296811 14556 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: loading cluster ID for follower catalog manager: success
I20260808 05:12:23.297688 14556 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: acquiring CA information for follower catalog manager: success
I20260808 05:12:23.298007 14556 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6afb39a8ae5a4fb2901af26835b4b444: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:12:23.375418 14623 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: acquiring CA information for follower catalog manager: success
I20260808 05:12:23.375797 14623 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4ed02fe9fcf5405e9fe337cf1b80341f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:12:23.463403 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:23.460774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48138 (local address 127.12.251.61:35191)
0808 05:12:23.460891 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:23.460894 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:23.460948 (+ 54us) server_negotiation.cc:407] Connection header received
0808 05:12:23.461031 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:23.461032 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:23.461086 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:23.461149 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:23.461329 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.461867 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.462623 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.462829 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.462885 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:23.463055 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:23.463176 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:23.463244 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:23.463286 (+ 42us) server_negotiation.cc:299] Negotiation successful
0808 05:12:23.463315 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":59,"threads_started":1}
I20260808 05:12:23.467350 14758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:23.465129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40984 (local address 127.12.251.60:43021)
0808 05:12:23.465243 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:23.465245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:23.465255 (+ 10us) server_negotiation.cc:407] Connection header received
0808 05:12:23.465313 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:23.465314 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:23.465348 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:23.465424 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:23.465511 (+ 87us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.465993 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.466756 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.466950 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.466992 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:23.467103 (+ 111us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:23.467199 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:23.467246 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:23.467273 (+ 27us) server_negotiation.cc:299] Negotiation successful
0808 05:12:23.467288 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":50,"threads_started":1}
I20260808 05:12:23.471622 14745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:23.468984 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48142 (local address 127.12.251.61:35191)
0808 05:12:23.469165 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:23.469167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:23.469175 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:12:23.469200 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:23.469201 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:23.469210 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:23.469293 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:23.469411 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.469966 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.470919 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.471207 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.471258 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:23.471382 (+ 124us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:23.471415 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:23.471461 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:23.471525 (+ 64us) server_negotiation.cc:299] Negotiation successful
0808 05:12:23.471547 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159}
I20260808 05:12:23.471805 14758 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:23.469089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40988 (local address 127.12.251.60:43021)
0808 05:12:23.469124 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:23.469126 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:23.469242 (+ 116us) server_negotiation.cc:407] Connection header received
0808 05:12:23.469300 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:23.469301 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:23.469317 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:23.469369 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:23.469464 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.470180 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.471099 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.471360 (+ 261us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.471413 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:23.471561 (+ 148us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:23.471594 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:23.471620 (+ 26us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:23.471722 (+ 102us) server_negotiation.cc:299] Negotiation successful
0808 05:12:23.471744 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260808 05:12:23.472157 14768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:23.469051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59322 (local address 127.12.251.62:44553)
0808 05:12:23.469371 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:23.469373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:23.469380 (+ 7us) server_negotiation.cc:407] Connection header received
0808 05:12:23.469421 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:23.469422 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:23.469470 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:23.469549 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:23.469649 (+ 100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.470404 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.471217 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:23.471520 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:23.471573 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:23.471847 (+ 274us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:23.471956 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:23.472021 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:23.472049 (+ 28us) server_negotiation.cc:299] Negotiation successful
0808 05:12:23.472075 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":297,"thread_start_us":62,"threads_started":1}
I20260808 05:12:23.473654 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14214
I20260808 05:12:23.491987 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14324
I20260808 05:12:23.499111 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14436
2026-08-08T05:12:23Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2873 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 08 05:12:23 dist-test-slave-bndk krb5kdc[14771](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 08 05:12:23 dist-test-slave-bndk krb5kdc[14771](info): set up 2 sockets
Aug 08 05:12:23 dist-test-slave-bndk krb5kdc[14771](info): commencing operation
krb5kdc: starting...
W20260808 05:12:24.625805 13292 mini_kdc.cc:121] Time spent starting KDC: real 1.103s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/test-user.keytab.
Aug 08 05:12:24 dist-test-slave-bndk krb5kdc[14771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-08T05:12:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-08T05:12:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.251.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
Entry for principal kudu/127.12.251.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab.
I20260808 05:12:24.738133 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42885
--webserver_interface=127.12.251.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:42885,127.12.251.61:37877,127.12.251.60:36933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260808 05:12:24.818202 14793 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:12:24.818415 14793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:24.818439 14793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:24.818465 14793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:24.819566 14793 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:24.819607 14793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:24.819625 14793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:24.819641 14793 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:24.819656 14793 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:24.821255 14793 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:42885,127.12.251.61:37877,127.12.251.60:36933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.62.keytab
--principal=kudu/127.12.251.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.62:42885
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.251.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14793
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:24.821502 14793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:24.821709 14793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:24.826295 14803 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:24.826400 14801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:24.826314 14798 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:24.826509 14793 server_base.cc:1034] running on GCE node
I20260808 05:12:24.826753 14793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:24.827030 14793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:24.828171 14793 hybrid_clock.cc:648] HybridClock initialized: now 1786165944828155 us; error 37 us; skew 500 ppm
Aug 08 05:12:24 dist-test-slave-bndk krb5kdc[14771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:24.834728 14793 init.cc:377] Logged in from keytab as kudu/127.12.251.62@KRBTEST.COM (short username kudu)
I20260808 05:12:24.835147 14793 webserver.cc:460] Webserver started at http://127.12.251.62:38195/ using document root <none> and password file <none>
I20260808 05:12:24.835343 14793 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:24.835390 14793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:24.835520 14793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:24.836560 14793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data/instance:
uuid: "148338aee4c34d868dfba9a2c013a8d4"
format_stamp: "Formatted at 2026-08-08 05:12:24 on dist-test-slave-bndk"
server_key: "bdeeff76bc7b8add26d21470a9b42b98"
server_key_iv: "b2c4267dc6e118328a8d2777f954d5d1"
server_key_version: "encryptionkey@0"
I20260808 05:12:24.836894 14793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/wal/instance:
uuid: "148338aee4c34d868dfba9a2c013a8d4"
format_stamp: "Formatted at 2026-08-08 05:12:24 on dist-test-slave-bndk"
server_key: "bdeeff76bc7b8add26d21470a9b42b98"
server_key_iv: "b2c4267dc6e118328a8d2777f954d5d1"
server_key_version: "encryptionkey@0"
I20260808 05:12:24.838193 14793 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260808 05:12:24.838840 14811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:24.839012 14793 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260808 05:12:24.839098 14793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/wal
uuid: "148338aee4c34d868dfba9a2c013a8d4"
format_stamp: "Formatted at 2026-08-08 05:12:24 on dist-test-slave-bndk"
server_key: "bdeeff76bc7b8add26d21470a9b42b98"
server_key_iv: "b2c4267dc6e118328a8d2777f954d5d1"
server_key_version: "encryptionkey@0"
I20260808 05:12:24.839157 14793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:24.849105 14793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:24.851118 14793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:24.851248 14793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:24.855072 14793 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.62:42885
I20260808 05:12:24.855105 14881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.62:42885 every 8 connection(s)
I20260808 05:12:24.855409 14793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/data/info.pb
I20260808 05:12:24.856317 14883 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:24.857903 14883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:24.862618 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14793
I20260808 05:12:24.862708 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-0/wal/instance
I20260808 05:12:24.862874 13292 external_mini_cluster.cc:1428] Setting key 97c4d55c9651a0f70cf83e5a839e01b2
Aug 08 05:12:24 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
I20260808 05:12:24.866976 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.858530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57388 (local address 127.12.251.62:42885)
0808 05:12:24.858670 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:24.858678 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:24.858786 (+ 108us) server_negotiation.cc:407] Connection header received
0808 05:12:24.859335 (+ 549us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:24.859337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:24.859353 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:24.859427 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:24.859994 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:24.860812 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:24.861671 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:24.861960 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:24.862050 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:24.864053 (+ 2003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:24.864062 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:24.864063 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:24.864070 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:24.865579 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:24.865962 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:24.865964 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:24.865965 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:24.866036 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:24.866244 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:24.866244 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:24.866244 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:24.866450 (+ 206us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:24.866508 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:24.866721 (+ 213us) server_negotiation.cc:299] Negotiation successful
0808 05:12:24.866814 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
I20260808 05:12:24.867004 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.858479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42885 (local address 127.0.0.1:57388)
0808 05:12:24.858660 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:24.858703 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:24.859181 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:24.859439 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:24.859441 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:24.859744 (+ 303us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:24.859896 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:24.859901 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:24.860897 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:24.860898 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:24.861600 (+ 702us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:24.861602 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:24.862065 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:24.862066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:24.862129 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:24.862525 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:24.862532 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:24.863971 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:24.865653 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:24.865661 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:24.865663 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:24.865890 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:24.866089 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:24.866089 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:24.866090 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:24.866190 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:24.866518 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:24.866525 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:24.866598 (+ 73us) client_negotiation.cc:769] Sending connection context
0808 05:12:24.866692 (+ 94us) client_negotiation.cc:240] Negotiation successful
0808 05:12:24.866897 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"mutex_wait_us":61,"thread_start_us":90,"threads_started":1}
I20260808 05:12:24.867947 14883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:24.868273 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.868146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51152)
0808 05:12:24.868195 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:24.868249 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260808 05:12:24.868418 14814 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
I20260808 05:12:24.868818 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.868726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51162)
0808 05:12:24.868768 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:24.868797 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 05:12:24.868920 14883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:37877: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.251.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab.
Entry for principal kudu/127.12.251.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab.
I20260808 05:12:24.887295 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:37877
--webserver_interface=127.12.251.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab
--principal=kudu/127.12.251.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:42885,127.12.251.61:37877,127.12.251.60:36933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:12:24.918145 14883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } attempt: 1
I20260808 05:12:24.918660 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.918521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51170)
0808 05:12:24.918578 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:24.918624 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:12:24.919052 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.918945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51182)
0808 05:12:24.918993 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:24.919025 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 05:12:24.919154 14883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:37877: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
W20260808 05:12:24.970364 14896 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:12:24.970587 14896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:24.970603 14896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:24.970623 14896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:24.971801 14896 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:24.971845 14896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:24.971858 14896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:24.971869 14896 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:24.971880 14896 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:24.973426 14896 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:42885,127.12.251.61:37877,127.12.251.60:36933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.61.keytab
--principal=kudu/127.12.251.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.61:37877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.251.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14896
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:24.973635 14896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:24.973831 14896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:24.978451 14905 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:24.978552 14903 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:24.978480 14902 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:24.978659 14896 server_base.cc:1034] running on GCE node
I20260808 05:12:24.978880 14896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:24.979157 14896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:24.980309 14896 hybrid_clock.cc:648] HybridClock initialized: now 1786165944980289 us; error 33 us; skew 500 ppm
Aug 08 05:12:24 dist-test-slave-bndk krb5kdc[14771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:24.982857 14896 init.cc:377] Logged in from keytab as kudu/127.12.251.61@KRBTEST.COM (short username kudu)
I20260808 05:12:24.983311 14896 webserver.cc:460] Webserver started at http://127.12.251.61:35219/ using document root <none> and password file <none>
I20260808 05:12:24.983530 14896 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:24.983578 14896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:24.983704 14896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:24.984747 14896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data/instance:
uuid: "2ea989b1e4194227869e223293b9133e"
format_stamp: "Formatted at 2026-08-08 05:12:24 on dist-test-slave-bndk"
server_key: "6c18698abace7e1ecf07c8efd8d24b7a"
server_key_iv: "09eba498b014e711bd4e4f7474824b87"
server_key_version: "encryptionkey@0"
I20260808 05:12:24.985076 14896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/wal/instance:
uuid: "2ea989b1e4194227869e223293b9133e"
format_stamp: "Formatted at 2026-08-08 05:12:24 on dist-test-slave-bndk"
server_key: "6c18698abace7e1ecf07c8efd8d24b7a"
server_key_iv: "09eba498b014e711bd4e4f7474824b87"
server_key_version: "encryptionkey@0"
I20260808 05:12:24.986449 14896 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:12:24.987193 14917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:24.987319 14883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } attempt: 2
I20260808 05:12:24.987524 14896 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260808 05:12:24.987624 14896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/wal
uuid: "2ea989b1e4194227869e223293b9133e"
format_stamp: "Formatted at 2026-08-08 05:12:24 on dist-test-slave-bndk"
server_key: "6c18698abace7e1ecf07c8efd8d24b7a"
server_key_iv: "09eba498b014e711bd4e4f7474824b87"
server_key_version: "encryptionkey@0"
I20260808 05:12:24.987713 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.987557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51190)
0808 05:12:24.987622 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:24.987677 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260808 05:12:24.987715 14896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:24.988101 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:24.987974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51202)
0808 05:12:24.988034 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:24.988076 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260808 05:12:24.988219 14883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.61:37877: Network error: Client connection negotiation failed: client connection to 127.12.251.61:37877: connect: Connection refused (error 111)
I20260808 05:12:25.024603 14896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:25.026685 14896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:25.026803 14896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:25.030634 14896 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.61:37877
I20260808 05:12:25.030683 14991 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.61:37877 every 8 connection(s)
I20260808 05:12:25.031036 14896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/data/info.pb
I20260808 05:12:25.032019 14992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:25.032512 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 14896
I20260808 05:12:25.032624 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-1/wal/instance
I20260808 05:12:25.032810 13292 external_mini_cluster.cc:1428] Setting key 463243a090e45434e52de2c5f2f86150
I20260808 05:12:25.034093 14992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.251.60@KRBTEST.COM; defaulting to no policy
I20260808 05:12:25.043134 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.034880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57392 (local address 127.12.251.62:42885)
0808 05:12:25.034929 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.034931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.035186 (+ 255us) server_negotiation.cc:407] Connection header received
0808 05:12:25.035697 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.035699 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.035714 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.035764 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.036412 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.036906 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.037902 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.038118 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.038174 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.040511 (+ 2337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.040513 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.040513 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.040521 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.041899 (+ 1378us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.042264 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.042265 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.042266 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.042317 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.042596 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.042597 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.042597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.042689 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.042732 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.042965 (+ 233us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.043067 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260808 05:12:25.043246 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.034877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42885 (local address 127.0.0.1:57392)
0808 05:12:25.035049 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.035093 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.035601 (+ 508us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.035842 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.035847 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.036120 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.036320 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.036324 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.036987 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.036988 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.037821 (+ 833us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.037824 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.038198 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.038199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.038323 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.038823 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.038832 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.040407 (+ 1575us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.041969 (+ 1562us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.041977 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.041978 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.042198 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.042417 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.042418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.042418 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.042545 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.042732 (+ 187us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.042736 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.042847 (+ 111us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.042943 (+ 96us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.043069 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.251.60@KRBTEST.COM" created.
I20260808 05:12:25.043787 14992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:25.051702 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.045258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51206)
0808 05:12:25.045408 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.045419 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.045466 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.045605 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.045606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.045737 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.045782 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.045783 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.046590 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.046591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.047070 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.047072 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.047494 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.047495 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.047555 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.047934 (+ 379us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.047937 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.049281 (+ 1344us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.050791 (+ 1510us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.050792 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.050792 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.051000 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.051171 (+ 171us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.051172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.051172 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.051234 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.051463 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.051464 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.051502 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.051554 (+ 52us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.051635 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260808 05:12:25.051795 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.045294 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51206 (local address 127.12.251.61:37877)
0808 05:12:25.045424 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.045428 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.045464 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:12:25.045516 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.045519 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.045531 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.045594 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.045843 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.046521 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.047133 (+ 612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.047434 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.047489 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.049366 (+ 1877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.049374 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.049374 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.049380 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.050709 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.051068 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.051070 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.051070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.051116 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.051285 (+ 169us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.051286 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.051286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.051412 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.051468 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.051577 (+ 109us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.051690 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":42,"server-negotiator.queue_time_us":105,"thread_start_us":69,"threads_started":1}
I20260808 05:12:25.052277 14992 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:25.052626 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.052501 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42276)
0808 05:12:25.052560 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.052606 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260808 05:12:25.052763 14920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
I20260808 05:12:25.053135 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.053054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42292)
0808 05:12:25.053095 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.053119 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
W20260808 05:12:25.053256 14992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:36933: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.251.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab.
Entry for principal kudu/127.12.251.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab.
I20260808 05:12:25.059224 13292 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
/tmp/dist-test-taskTWVJbZ/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:36933
--webserver_interface=127.12.251.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab
--principal=kudu/127.12.251.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.251.20:35119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.251.62:42885,127.12.251.61:37877,127.12.251.60:36933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260808 05:12:25.079380 14883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } attempt: 3
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:25.086006 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.079736 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51210)
0808 05:12:25.079802 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.079813 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.079863 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.079989 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.079990 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.080156 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.080218 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.080220 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.080870 (+ 650us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.080872 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.081451 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.081454 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.081814 (+ 360us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.081815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.081886 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.082332 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.082336 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.083712 (+ 1376us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.085070 (+ 1358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.085071 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.085072 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.085264 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.085425 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.085426 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.085426 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.085483 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.085694 (+ 211us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.085695 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.085744 (+ 49us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.085804 (+ 60us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.085905 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260808 05:12:25.086023 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.079811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51210 (local address 127.12.251.61:37877)
0808 05:12:25.079875 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.079878 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.079889 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:12:25.079920 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.079922 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.079934 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.079979 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.080298 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.080793 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.081530 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.081752 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.081810 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.083799 (+ 1989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.083800 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.083800 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.083806 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.084990 (+ 1184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.085318 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.085319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.085319 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.085372 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.085535 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.085535 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.085536 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.085640 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.085695 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.085832 (+ 137us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.085905 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260808 05:12:25.086522 14883 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:25.086880 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.086786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42308)
0808 05:12:25.086830 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.086859 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260808 05:12:25.087201 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.087121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42324)
0808 05:12:25.087156 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.087179 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 05:12:25.087275 14883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:36933: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
I20260808 05:12:25.102459 14992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } attempt: 1
I20260808 05:12:25.102949 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.102824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42330)
0808 05:12:25.102881 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.102920 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:12:25.103252 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.103180 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42346)
0808 05:12:25.103212 (+ 32us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.103235 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260808 05:12:25.103336 14992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:36933: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
I20260808 05:12:25.118414 14883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } attempt: 1
I20260808 05:12:25.118845 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.118733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42362)
0808 05:12:25.118786 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.118816 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260808 05:12:25.119238 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.119105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42378)
0808 05:12:25.119161 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.119205 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260808 05:12:25.119359 14883 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:36933: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
W20260808 05:12:25.143296 15001 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260808 05:12:25.143518 15001 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260808 05:12:25.143534 15001 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260808 05:12:25.143558 15001 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260808 05:12:25.144681 15001 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260808 05:12:25.144722 15001 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260808 05:12:25.144735 15001 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260808 05:12:25.144749 15001 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260808 05:12:25.144773 15001 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260808 05:12:25.146261 15001 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.251.20:35119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.251.62:42885,127.12.251.61:37877,127.12.251.60:36933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/krb5kdc/kudu_127.12.251.60.keytab
--principal=kudu/127.12.251.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.251.60:36933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.251.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15001
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 08 Aug 2026 04:08:35 UTC on ccycloud.quasar-ozjjgu.root.comops.site
build id 4574102
I20260808 05:12:25.146503 15001 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260808 05:12:25.146718 15001 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260808 05:12:25.151289 15012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:25.151321 15009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260808 05:12:25.151324 15010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260808 05:12:25.151353 15001 server_base.cc:1034] running on GCE node
I20260808 05:12:25.151858 15001 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260808 05:12:25.153416 15001 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260808 05:12:25.154592 15001 hybrid_clock.cc:648] HybridClock initialized: now 1786165945154573 us; error 29 us; skew 500 ppm
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165945, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260808 05:12:25.157027 15001 init.cc:377] Logged in from keytab as kudu/127.12.251.60@KRBTEST.COM (short username kudu)
I20260808 05:12:25.157512 15001 webserver.cc:460] Webserver started at http://127.12.251.60:41341/ using document root <none> and password file <none>
I20260808 05:12:25.157712 15001 fs_manager.cc:359] Metadata directory not provided
I20260808 05:12:25.157758 15001 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260808 05:12:25.157881 15001 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260808 05:12:25.158895 15001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data/instance:
uuid: "696606d858a44e67b1c68bdbde9208c1"
format_stamp: "Formatted at 2026-08-08 05:12:25 on dist-test-slave-bndk"
server_key: "b67b77bfd077fe90bced3630674081e4"
server_key_iv: "a435233ca9dd16fff114a6f6d252b0d9"
server_key_version: "encryptionkey@0"
I20260808 05:12:25.159236 15001 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/wal/instance:
uuid: "696606d858a44e67b1c68bdbde9208c1"
format_stamp: "Formatted at 2026-08-08 05:12:25 on dist-test-slave-bndk"
server_key: "b67b77bfd077fe90bced3630674081e4"
server_key_iv: "a435233ca9dd16fff114a6f6d252b0d9"
server_key_version: "encryptionkey@0"
I20260808 05:12:25.160542 15001 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260808 05:12:25.161181 15025 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260808 05:12:25.161332 15001 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260808 05:12:25.161414 15001 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data,/tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/wal
uuid: "696606d858a44e67b1c68bdbde9208c1"
format_stamp: "Formatted at 2026-08-08 05:12:25 on dist-test-slave-bndk"
server_key: "b67b77bfd077fe90bced3630674081e4"
server_key_iv: "a435233ca9dd16fff114a6f6d252b0d9"
server_key_version: "encryptionkey@0"
I20260808 05:12:25.161481 15001 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260808 05:12:25.171514 14992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } attempt: 2
I20260808 05:12:25.171902 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.171765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42390)
0808 05:12:25.171823 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.171864 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260808 05:12:25.172199 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.172128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42392)
0808 05:12:25.172163 (+ 35us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.172183 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260808 05:12:25.172282 14992 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.251.60:36933: Network error: Client connection negotiation failed: client connection to 127.12.251.60:36933: connect: Connection refused (error 111)
I20260808 05:12:25.177415 15001 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260808 05:12:25.179008 15001 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260808 05:12:25.179123 15001 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260808 05:12:25.182888 15001 rpc_server.cc:307] RPC server started. Bound to: 127.12.251.60:36933
I20260808 05:12:25.182920 15103 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.251.60:36933 every 8 connection(s)
I20260808 05:12:25.183236 15001 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/data/info.pb
I20260808 05:12:25.184190 15104 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260808 05:12:25.184504 13292 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu as pid 15001
I20260808 05:12:25.184617 13292 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskTWVJbZ/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786165676707025-13292-0/minicluster-data/master-2/wal/instance
I20260808 05:12:25.184800 13292 external_mini_cluster.cc:1428] Setting key 9c515d95fa5dd4ba96c71c1a4d6aabce
I20260808 05:12:25.186220 15104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165945, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:12:25.194414 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.186922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57398 (local address 127.12.251.62:42885)
0808 05:12:25.186969 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.186971 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.187169 (+ 198us) server_negotiation.cc:407] Connection header received
0808 05:12:25.187224 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.187225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.187236 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.187278 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.187750 (+ 472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.188424 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.189403 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.189676 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.189739 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.191717 (+ 1978us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.191719 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.191719 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.191725 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.193063 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.193533 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.193533 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.193534 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.193584 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.193821 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.193821 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.193822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.193911 (+ 89us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.193967 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.194263 (+ 296us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.194343 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:12:25.194605 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.186889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.62:42885 (local address 127.0.0.1:57398)
0808 05:12:25.187072 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.187105 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.187166 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.187307 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.187310 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.187563 (+ 253us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.187657 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.187661 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.188509 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.188510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.189327 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.189330 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.189768 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.189769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.189844 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.190187 (+ 343us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.190195 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.191637 (+ 1442us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.193141 (+ 1504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.193148 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.193151 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.193466 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.193641 (+ 175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.193642 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.193642 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.193765 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.193963 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.193968 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.194116 (+ 148us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.194226 (+ 110us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.194362 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":104,"threads_started":1}
I20260808 05:12:25.194579 14883 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } attempt: 2
I20260808 05:12:25.195050 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.185298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42398 (local address 127.12.251.60:36933)
0808 05:12:25.185525 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.185535 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.185571 (+ 36us) server_negotiation.cc:407] Connection header received
0808 05:12:25.186070 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.186079 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.186142 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.186295 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.186974 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.187855 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.188770 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.189370 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.189467 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.192224 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.192232 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.192232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.192239 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.193842 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.194170 (+ 328us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.194172 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.194173 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.194237 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.194427 (+ 190us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.194428 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.194428 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.194587 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.194854 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.194900 (+ 46us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.194978 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":79,"threads_started":1}
I20260808 05:12:25.195402 15104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } has no permanent_uuid. Determining permanent_uuid...
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.62@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.62@KRBTEST.COM
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165945, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:25.202425 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.194991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42404 (local address 127.12.251.60:36933)
0808 05:12:25.195105 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.195106 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.195114 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:12:25.195131 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.195132 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.195140 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.195191 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.195467 (+ 276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.196212 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.197572 (+ 1360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.197862 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.197914 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.199889 (+ 1975us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.199890 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.199890 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.199896 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.201355 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.201758 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.201759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.201759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.201805 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.201975 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.201976 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.201976 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.202081 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.202133 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.202266 (+ 133us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.202331 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":87,"threads_started":1}
I20260808 05:12:25.202425 14887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.194784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42404)
0808 05:12:25.194879 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.194888 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.194921 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.195199 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.195200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.195342 (+ 142us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.195380 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.195382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.196276 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.196277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.197498 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.197501 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.197926 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.197927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.197986 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.198641 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.198645 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.199815 (+ 1170us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.201447 (+ 1632us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.201448 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.201448 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.201687 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.201864 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.201865 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.201866 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.201924 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.202137 (+ 213us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.202138 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.202179 (+ 41us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.202240 (+ 61us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.202329 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":82}
I20260808 05:12:25.203189 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.195750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57404 (local address 127.12.251.62:42885)
0808 05:12:25.195781 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.195782 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.195790 (+ 8us) server_negotiation.cc:407] Connection header received
0808 05:12:25.195840 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.195841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.195849 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.195905 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.196295 (+ 390us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.196899 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.197784 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.198059 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.198116 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.200538 (+ 2422us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.200540 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.200540 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.200547 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.202047 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.202413 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.202414 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.202415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.202491 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.202687 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.202688 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.202689 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.202814 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.202975 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.203037 (+ 62us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.203113 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":33,"server-negotiator.queue_time_us":15}
I20260808 05:12:25.203315 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.195699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51224 (local address 127.12.251.61:37877)
0808 05:12:25.195748 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.195750 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.196326 (+ 576us) server_negotiation.cc:407] Connection header received
0808 05:12:25.196376 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.196377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.196389 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.196438 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.196688 (+ 250us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.197390 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.198204 (+ 814us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.198525 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.198579 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.200810 (+ 2231us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.200811 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.200811 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.200818 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.202214 (+ 1396us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.202557 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.202558 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.202558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.202609 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.202790 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.202791 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.202791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.202913 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.202974 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.203162 (+ 188us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.203231 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:12:25.203635 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.195608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.61:37877 (local address 127.0.0.1:51224)
0808 05:12:25.196285 (+ 677us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.196294 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.196328 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.196440 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.196440 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.196578 (+ 138us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.196624 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.196625 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.197478 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.197479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.198129 (+ 650us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.198131 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.198598 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.198599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.198672 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.198996 (+ 324us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.199001 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.200745 (+ 1744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.202291 (+ 1546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.202292 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.202292 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.202476 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.202679 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.202680 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.202680 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.202732 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.203002 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.203002 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.203040 (+ 38us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.203468 (+ 428us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.203561 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":664}
I20260808 05:12:25.203958 15104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } has no permanent_uuid. Determining permanent_uuid...
I20260808 05:12:25.204321 14883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4: Bootstrap starting.
I20260808 05:12:25.204973 14883 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:25.205267 14883 log.cc:824] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:25.206000 14883 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4: No bootstrap required, opened a new log
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165945, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.60@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:12:25.207976 14883 raft_consensus.cc:348] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
I20260808 05:12:25.208122 14883 raft_consensus.cc:729] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 148338aee4c34d868dfba9a2c013a8d4, State: Initialized, Role: FOLLOWER
I20260808 05:12:25.208210 14883 consensus_queue.cc:260] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.251.61@KRBTEST.COM
I20260808 05:12:25.208551 14883 sys_catalog.cc:564] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:25.208775 15114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.209568 15114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:12:25.210664 15129 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:12:25.210714 15129 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:12:25.210783 15110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.204181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42408)
0808 05:12:25.204636 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.204645 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.204679 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.204765 (+ 86us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.204766 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.204883 (+ 117us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.204906 (+ 23us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.204907 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.205604 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.205605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.206197 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.206199 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.206517 (+ 318us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.206517 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.206561 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.206888 (+ 327us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.206893 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.207956 (+ 1063us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.209535 (+ 1579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.209536 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.209536 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.209734 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.210158 (+ 424us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.210159 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.210159 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.210224 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.210534 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.210535 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.210569 (+ 34us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.210626 (+ 57us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.210702 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":439}
I20260808 05:12:25.211016 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.204214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42408 (local address 127.12.251.60:36933)
0808 05:12:25.204252 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.204254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.204690 (+ 436us) server_negotiation.cc:407] Connection header received
0808 05:12:25.204712 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.204713 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.204720 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.204764 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.204964 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.205524 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.206274 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.206464 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.206514 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.208026 (+ 1512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.208027 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.208027 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.208033 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.209441 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.210030 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.210031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.210031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.210094 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.210295 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.210295 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.210296 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.210443 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.210501 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.210881 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.210942 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260808 05:12:25.211920 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.204072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51228 (local address 127.12.251.61:37877)
0808 05:12:25.204100 (+ 28us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.204101 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.204123 (+ 22us) server_negotiation.cc:407] Connection header received
0808 05:12:25.204139 (+ 16us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.204140 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.204148 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.204184 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.204645 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.205298 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.206173 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.206440 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.206481 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.209057 (+ 2576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.209059 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.209059 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.209066 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.210664 (+ 1598us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.211113 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.211114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.211115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.211171 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.211407 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.211408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.211409 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.211548 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.211698 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.211763 (+ 65us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.211836 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260808 05:12:25.212293 15104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: Bootstrap starting.
I20260808 05:12:25.213073 15104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:25.213351 15104 log.cc:824] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:25.214216 15104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: No bootstrap required, opened a new log
I20260808 05:12:25.216099 15104 raft_consensus.cc:348] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
I20260808 05:12:25.216248 15104 raft_consensus.cc:729] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 696606d858a44e67b1c68bdbde9208c1, State: Initialized, Role: FOLLOWER
I20260808 05:12:25.214107 14793 master_runner.cc:186] Error getting master registration for 127.12.251.61:37877: OK, instance_id { permanent_uuid: "2ea989b1e4194227869e223293b9133e" instance_seqno: 1786165945029539 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:12:25.216322 15104 consensus_queue.cc:260] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
I20260808 05:12:25.216384 14793 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:12:25.216624 15104 sys_catalog.cc:564] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:25.216584 15132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.216737 15132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:25.217922 13292 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260808 05:12:25.218813 14844 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "148338aee4c34d868dfba9a2c013a8d4"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57404
I20260808 05:12:25.218932 14844 raft_consensus.cc:482] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260808 05:12:25.218976 14844 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [term 0 FOLLOWER]: Advancing to term 1
W20260808 05:12:25.219362 15151 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:12:25.219409 15151 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:12:25.219708 14844 raft_consensus.cc:504] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
I20260808 05:12:25.219926 14844 leader_election.cc:288] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [CANDIDATE]: Term 1 election: Requested vote from peers 2ea989b1e4194227869e223293b9133e (127.12.251.61:37877), 696606d858a44e67b1c68bdbde9208c1 (127.12.251.60:36933)
I20260808 05:12:25.220191 15062 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "148338aee4c34d868dfba9a2c013a8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "696606d858a44e67b1c68bdbde9208c1"
I20260808 05:12:25.220301 15062 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [term 0 FOLLOWER]: Advancing to term 1
I20260808 05:12:25.221138 15062 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148338aee4c34d868dfba9a2c013a8d4 in term 1.
I20260808 05:12:25.221426 14813 leader_election.cc:302] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 148338aee4c34d868dfba9a2c013a8d4, 696606d858a44e67b1c68bdbde9208c1; no voters:
I20260808 05:12:25.221558 15114 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260808 05:12:25.221706 15114 raft_consensus.cc:686] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [term 1 LEADER]: Becoming Leader. State: Replica: 148338aee4c34d868dfba9a2c013a8d4, State: Running, Role: LEADER
I20260808 05:12:25.221784 15114 consensus_queue.cc:237] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
I20260808 05:12:25.222175 15114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 148338aee4c34d868dfba9a2c013a8d4. Latest consensus state: current_term: 1 leader_uuid: "148338aee4c34d868dfba9a2c013a8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.222254 15114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:25.220672 15001 master_runner.cc:186] Error getting master registration for 127.12.251.61:37877: OK, instance_id { permanent_uuid: "2ea989b1e4194227869e223293b9133e" instance_seqno: 1786165945029539 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260808 05:12:25.223359 15001 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260808 05:12:25.229369 15161 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260808 05:12:25.229570 15161 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260808 05:12:25.231827 15062 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [term 1 FOLLOWER]: Refusing update from remote peer 148338aee4c34d868dfba9a2c013a8d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:12:25.232179 15159 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:12:25.233698 15132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 148338aee4c34d868dfba9a2c013a8d4. Latest consensus state: current_term: 1 leader_uuid: "148338aee4c34d868dfba9a2c013a8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.233776 15132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:25.235139 15162 mvcc.cc:205] Tried to move back new op lower bound from 7316135711666634752 to 7316135711629115392. Current Snapshot: MvccSnapshot[applied={T|T < 7316135711666634752}]
I20260808 05:12:25.235209 15114 sys_catalog.cc:455] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "148338aee4c34d868dfba9a2c013a8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.235270 15114 sys_catalog.cc:458] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: This master's current role is: LEADER
I20260808 05:12:25.235898 15132 sys_catalog.cc:455] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "148338aee4c34d868dfba9a2c013a8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.235992 15132 sys_catalog.cc:458] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1 [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:25.236137 15161 catalog_manager.cc:1347] Generated new cluster ID: ab2876588b1746f799032fcc0a529e2b
I20260808 05:12:25.236176 15161 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260808 05:12:25.242782 14888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.230436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57408 (local address 127.12.251.62:42885)
0808 05:12:25.230475 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.230477 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.231540 (+ 1063us) server_negotiation.cc:407] Connection header received
0808 05:12:25.231641 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.231642 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.231653 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.231684 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.232435 (+ 751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.233114 (+ 679us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.234083 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.234385 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.234453 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.238339 (+ 3886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.238354 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.238354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.238361 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.239820 (+ 1459us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.241270 (+ 1450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.241271 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.241271 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.241339 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.241895 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.241896 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.241897 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.242035 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.242103 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.242607 (+ 504us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.242683 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:12:25.244637 15167 mvcc.cc:205] Tried to move back new op lower bound from 7316135711666634752 to 7316135711629115392. Current Snapshot: MvccSnapshot[applied={T|T < 7316135711666634752 or (T in {7316135711666634752})}]
I20260808 05:12:25.253458 15161 catalog_manager.cc:1370] Generated new certificate authority record
I20260808 05:12:25.254166 15161 catalog_manager.cc:1504] Loading token signing keys...
I20260808 05:12:25.255071 14999 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.230646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51230 (local address 127.12.251.61:37877)
0808 05:12:25.230687 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.230689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.235785 (+ 5096us) server_negotiation.cc:407] Connection header received
0808 05:12:25.235807 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.235808 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.235817 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.235858 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.239891 (+ 4033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.240587 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.245174 (+ 4587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.245939 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.245982 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.250571 (+ 4589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.250572 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.250572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.250591 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.252125 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.253631 (+ 1506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.253632 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.253633 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.253693 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.254311 (+ 618us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.254312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.254313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.254442 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.254517 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.254897 (+ 380us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.254970 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:12:25.259775 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.230829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42424 (local address 127.12.251.60:36933)
0808 05:12:25.230865 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.230867 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.235682 (+ 4815us) server_negotiation.cc:407] Connection header received
0808 05:12:25.235703 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.235703 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.235713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.235756 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.247547 (+ 11791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.248238 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.252746 (+ 4508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.252995 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.253050 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.256768 (+ 3718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.256770 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.256770 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.256777 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.258320 (+ 1543us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.258841 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.258842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.258842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.258905 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.259163 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.259163 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.259164 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.259274 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.259339 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.259601 (+ 262us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.259686 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260808 05:12:25.261766 15161 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4: Generated new TSK 0
I20260808 05:12:25.262054 15161 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260808 05:12:25.263413 14992 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } attempt: 3
Aug 08 05:12:25 dist-test-slave-bndk krb5kdc[14771](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786165944, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.251.61@KRBTEST.COM for kudu/127.12.251.60@KRBTEST.COM
I20260808 05:12:25.270932 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.263683 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42426 (local address 127.12.251.60:36933)
0808 05:12:25.263731 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.263733 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.263742 (+ 9us) server_negotiation.cc:407] Connection header received
0808 05:12:25.263799 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.263800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.263809 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.263871 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.264346 (+ 475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.264979 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.265976 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.266268 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.266322 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.268299 (+ 1977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0808 05:12:25.268301 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0808 05:12:25.268302 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0808 05:12:25.268308 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0808 05:12:25.269860 (+ 1552us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.270227 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.270227 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.270228 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.270280 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0808 05:12:25.270437 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0808 05:12:25.270438 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0808 05:12:25.270438 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0808 05:12:25.270581 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0808 05:12:25.270637 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:25.270780 (+ 143us) server_negotiation.cc:299] Negotiation successful
0808 05:12:25.270843 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260808 05:12:25.270936 14997 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:25.263636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.251.60:36933 (local address 127.0.0.1:42426)
0808 05:12:25.263680 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0808 05:12:25.263692 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0808 05:12:25.263739 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0808 05:12:25.263875 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0808 05:12:25.263876 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0808 05:12:25.264046 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0808 05:12:25.264091 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.264093 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.265077 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.265078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.265872 (+ 794us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0808 05:12:25.265875 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0808 05:12:25.266370 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0808 05:12:25.266371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0808 05:12:25.266427 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:25.266763 (+ 336us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0808 05:12:25.266768 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0808 05:12:25.268197 (+ 1429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0808 05:12:25.269948 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.269949 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.269950 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.270158 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.270323 (+ 165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0808 05:12:25.270324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0808 05:12:25.270324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0808 05:12:25.270391 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0808 05:12:25.270643 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0808 05:12:25.270644 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0808 05:12:25.270686 (+ 42us) client_negotiation.cc:769] Sending connection context
0808 05:12:25.270745 (+ 59us) client_negotiation.cc:240] Negotiation successful
0808 05:12:25.270840 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22}
I20260808 05:12:25.272482 14992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: Bootstrap starting.
I20260808 05:12:25.273247 14992 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: Neither blocks nor log segments found. Creating new log.
I20260808 05:12:25.273558 14992 log.cc:824] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: Log is configured to *not* fsync() on all Append() calls
I20260808 05:12:25.274415 14992 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: No bootstrap required, opened a new log
I20260808 05:12:25.276325 14992 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
I20260808 05:12:25.276463 14992 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ea989b1e4194227869e223293b9133e, State: Initialized, Role: FOLLOWER
I20260808 05:12:25.276552 14992 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } }
I20260808 05:12:25.276863 14992 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [sys.catalog]: configured and running, proceeding with master startup.
I20260808 05:12:25.276908 14956 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "148338aee4c34d868dfba9a2c013a8d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "2ea989b1e4194227869e223293b9133e"
I20260808 05:12:25.276995 14956 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [term 0 FOLLOWER]: Advancing to term 1
W20260808 05:12:25.277369 14925 tablet.cc:2369] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260808 05:12:25.277927 14956 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 148338aee4c34d868dfba9a2c013a8d4 in term 1.
I20260808 05:12:25.278456 14955 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [term 1 FOLLOWER]: Refusing update from remote peer 148338aee4c34d868dfba9a2c013a8d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260808 05:12:25.278903 15159 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260808 05:12:25.276827 15180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.279564 15180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:25.280419 15180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 148338aee4c34d868dfba9a2c013a8d4. Latest consensus state: current_term: 1 leader_uuid: "148338aee4c34d868dfba9a2c013a8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.280486 15180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [sys.catalog]: This master's current role is: FOLLOWER
I20260808 05:12:25.280515 15180 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "148338aee4c34d868dfba9a2c013a8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.280545 15180 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e [sys.catalog]: This master's current role is: FOLLOWER
W20260808 05:12:25.280864 15201 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260808 05:12:25.280912 15201 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260808 05:12:25.281909 15203 mvcc.cc:205] Tried to move back new op lower bound from 7316135711787954176 to 7316135711629115392. Current Snapshot: MvccSnapshot[applied={T|T < 7316135711666634752}]
W20260808 05:12:25.294438 14888 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.292747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57412 (local address 127.12.251.62:42885)
0808 05:12:25.292791 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.292793 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.293733 (+ 940us) server_negotiation.cc:407] Connection header received
0808 05:12:25.293844 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.293845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.293857 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.293888 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.294359 (+ 471us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57412: BlockingRecv error: recv got EOF from 127.0.0.1:57412 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260808 05:12:25.295382 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.293122 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51246 (local address 127.12.251.61:37877)
0808 05:12:25.293157 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.293158 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.294862 (+ 1704us) server_negotiation.cc:407] Connection header received
0808 05:12:25.294957 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.294958 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.294970 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.294997 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.295309 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51246: BlockingRecv error: recv got EOF from 127.0.0.1:51246 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 05:12:25.296279 15108 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.293487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42432 (local address 127.12.251.60:36933)
0808 05:12:25.293529 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.293531 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.295688 (+ 2157us) server_negotiation.cc:407] Connection header received
0808 05:12:25.295784 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.295785 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.295795 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.295823 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.296213 (+ 390us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:42432: BlockingRecv error: recv got EOF from 127.0.0.1:42432 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:12:25.298337 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.297615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51254 (local address 127.12.251.61:37877)
0808 05:12:25.297646 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.297647 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.297849 (+ 202us) server_negotiation.cc:407] Connection header received
0808 05:12:25.297959 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.297960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.297977 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.298004 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.298283 (+ 279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51254: BlockingRecv error: recv got EOF from 127.0.0.1:51254 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 05:12:25.301327 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.300567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51264 (local address 127.12.251.61:37877)
0808 05:12:25.300596 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.300597 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.300829 (+ 232us) server_negotiation.cc:407] Connection header received
0808 05:12:25.300917 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.300918 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.300926 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.300952 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.301277 (+ 325us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51264: BlockingRecv error: recv got EOF from 127.0.0.1:51264 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 05:12:25.305037 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.304360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51268 (local address 127.12.251.61:37877)
0808 05:12:25.304389 (+ 29us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.304391 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.304603 (+ 212us) server_negotiation.cc:407] Connection header received
0808 05:12:25.304687 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.304688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.304697 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.304722 (+ 25us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.304997 (+ 275us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51268: BlockingRecv error: recv got EOF from 127.0.0.1:51268 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260808 05:12:25.314286 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.313511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51274 (local address 127.12.251.61:37877)
0808 05:12:25.313546 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.313547 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.313788 (+ 241us) server_negotiation.cc:407] Connection header received
0808 05:12:25.313882 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.313883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.313894 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.313921 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.314238 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51274: BlockingRecv error: recv got EOF from 127.0.0.1:51274 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260808 05:12:25.324309 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.323530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51278 (local address 127.12.251.61:37877)
0808 05:12:25.323565 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.323567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.323789 (+ 222us) server_negotiation.cc:407] Connection header received
0808 05:12:25.323885 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.323886 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.323897 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.323924 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.324248 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51278: BlockingRecv error: recv got EOF from 127.0.0.1:51278 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260808 05:12:25.342789 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.341881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51288 (local address 127.12.251.61:37877)
0808 05:12:25.341924 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.341926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.342183 (+ 257us) server_negotiation.cc:407] Connection header received
0808 05:12:25.342288 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.342289 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.342301 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.342330 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.342729 (+ 399us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51288: BlockingRecv error: recv got EOF from 127.0.0.1:51288 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260808 05:12:25.377554 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.376404 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51290 (local address 127.12.251.61:37877)
0808 05:12:25.376452 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.376454 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.376800 (+ 346us) server_negotiation.cc:407] Connection header received
0808 05:12:25.376988 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.376989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.377002 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.377035 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.377491 (+ 456us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51290: BlockingRecv error: recv got EOF from 127.0.0.1:51290 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260808 05:12:25.443725 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.442991 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.12.251.61:37877)
0808 05:12:25.443042 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.443044 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.443148 (+ 104us) server_negotiation.cc:407] Connection header received
0808 05:12:25.443227 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.443228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.443240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.443283 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.443661 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51296: BlockingRecv error: recv got EOF from 127.0.0.1:51296 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
W20260808 05:12:25.573547 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.572840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51298 (local address 127.12.251.61:37877)
0808 05:12:25.572893 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.572895 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.572998 (+ 103us) server_negotiation.cc:407] Connection header received
0808 05:12:25.573063 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.573065 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.573078 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.573129 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.573487 (+ 358us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51298: BlockingRecv error: recv got EOF from 127.0.0.1:51298 (error 108)
Metrics: {"server-negotiator.queue_time_us":28}
I20260808 05:12:25.660919 15159 sys_catalog.cc:455] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "148338aee4c34d868dfba9a2c013a8d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "148338aee4c34d868dfba9a2c013a8d4" member_type: VOTER last_known_addr { host: "127.12.251.62" port: 42885 } } peers { permanent_uuid: "2ea989b1e4194227869e223293b9133e" member_type: VOTER last_known_addr { host: "127.12.251.61" port: 37877 } } peers { permanent_uuid: "696606d858a44e67b1c68bdbde9208c1" member_type: VOTER last_known_addr { host: "127.12.251.60" port: 36933 } } }
I20260808 05:12:25.661085 15159 sys_catalog.cc:458] T 00000000000000000000000000000000 P 148338aee4c34d868dfba9a2c013a8d4 [sys.catalog]: This master's current role is: LEADER
W20260808 05:12:25.831363 14999 negotiation.cc:337] Failed RPC negotiation. Trace:
0808 05:12:25.830677 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51312 (local address 127.12.251.61:37877)
0808 05:12:25.830727 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:25.830729 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:25.830801 (+ 72us) server_negotiation.cc:407] Connection header received
0808 05:12:25.830868 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:25.830869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:25.830879 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:25.830938 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0808 05:12:25.831287 (+ 349us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51312: BlockingRecv error: recv got EOF from 127.0.0.1:51312 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
I20260808 05:12:26.219871 15151 catalog_manager.cc:1259] Loaded cluster ID: ab2876588b1746f799032fcc0a529e2b
I20260808 05:12:26.219949 15151 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: loading cluster ID for follower catalog manager: success
I20260808 05:12:26.220762 15151 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: acquiring CA information for follower catalog manager: success
I20260808 05:12:26.221063 15151 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 696606d858a44e67b1c68bdbde9208c1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:12:26.281344 15201 catalog_manager.cc:1259] Loaded cluster ID: ab2876588b1746f799032fcc0a529e2b
I20260808 05:12:26.281418 15201 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: loading cluster ID for follower catalog manager: success
I20260808 05:12:26.282183 15201 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: acquiring CA information for follower catalog manager: success
I20260808 05:12:26.282447 15201 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 2ea989b1e4194227869e223293b9133e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260808 05:12:26.346827 15308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:26.344525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51314 (local address 127.12.251.61:37877)
0808 05:12:26.344632 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:26.344633 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:26.344644 (+ 11us) server_negotiation.cc:407] Connection header received
0808 05:12:26.344711 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:26.344711 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:26.344767 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:26.344841 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:26.344958 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.345484 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.346185 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.346380 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.346448 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:26.346545 (+ 97us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:26.346656 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:26.346708 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:26.346723 (+ 15us) server_negotiation.cc:299] Negotiation successful
0808 05:12:26.346739 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":61,"threads_started":1}
I20260808 05:12:26.350644 15318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:26.348513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42434 (local address 127.12.251.60:36933)
0808 05:12:26.348628 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:26.348630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:26.348658 (+ 28us) server_negotiation.cc:407] Connection header received
0808 05:12:26.348694 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:26.348694 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:26.348727 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:26.348785 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:26.348861 (+ 76us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.349396 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.350064 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.350248 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.350288 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:26.350398 (+ 110us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:26.350497 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:26.350551 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:26.350567 (+ 16us) server_negotiation.cc:299] Negotiation successful
0808 05:12:26.350583 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":58,"threads_started":1}
I20260808 05:12:26.354981 15318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:26.352156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42448 (local address 127.12.251.60:36933)
0808 05:12:26.352199 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:26.352201 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:26.352548 (+ 347us) server_negotiation.cc:407] Connection header received
0808 05:12:26.352577 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:26.352578 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:26.352588 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:26.352636 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:26.352849 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.353558 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.354273 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.354546 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.354606 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:26.354725 (+ 119us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:26.354760 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:26.354805 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:26.354881 (+ 76us) server_negotiation.cc:299] Negotiation successful
0808 05:12:26.354903 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:12:26.355137 15308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:26.352273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51316 (local address 127.12.251.61:37877)
0808 05:12:26.352315 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:26.352316 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:26.352412 (+ 96us) server_negotiation.cc:407] Connection header received
0808 05:12:26.352496 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:26.352497 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:26.352507 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:26.352555 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:26.352694 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.353457 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.354400 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.354616 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.354669 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:26.354805 (+ 136us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:26.354833 (+ 28us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:26.354874 (+ 41us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:26.355040 (+ 166us) server_negotiation.cc:299] Negotiation successful
0808 05:12:26.355064 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260808 05:12:26.355242 15333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0808 05:12:26.352160 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57422 (local address 127.12.251.62:42885)
0808 05:12:26.352289 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0808 05:12:26.352291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0808 05:12:26.352406 (+ 115us) server_negotiation.cc:407] Connection header received
0808 05:12:26.352504 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0808 05:12:26.352514 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0808 05:12:26.352565 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0808 05:12:26.352640 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0808 05:12:26.352750 (+ 110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.353300 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.354340 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0808 05:12:26.354640 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0808 05:12:26.354695 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0808 05:12:26.354881 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0808 05:12:26.354985 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0808 05:12:26.355043 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0808 05:12:26.355142 (+ 99us) server_negotiation.cc:299] Negotiation successful
0808 05:12:26.355167 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":59,"threads_started":1}
I20260808 05:12:26.356805 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14793
I20260808 05:12:26.371387 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 14896
I20260808 05:12:26.380167 13292 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskTWVJbZ/build/release/bin/kudu with pid 15001
2026-08-08T05:12:26Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2877 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5751 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (269668 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST